Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.563477677s FAIL (2025-07-18 10:17:38 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 599]: Uploading segments... Jul 18 10:15:11.294485085 (601h4m11.177898712s) [upload=480599]: Got next segment. Inline: false Jul 18 10:15:11.294544272 (601h4m11.177957885s) [upload=480599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:15:11.294550582 (601h4m11.177964195s) [upload=480599]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:15:11.501406888 (601h4m11.384820518s) [seg_pos={0 0}, upload=480599]: Begin upload segment... Jul 18 10:15:11.501484361 (601h4m11.384897977s) [seg_pos={0 0}, upload=480599]: Done begin upload segment. Jul 18 10:15:11.501520374 (601h4m11.384934003s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.501569822 (601h4m11.384983455s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502348936 (601h4m11.385762573s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502573055 (601h4m11.38598669s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503277563 (601h4m11.386691202s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503364061 (601h4m11.386777691s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504187187 (601h4m11.387600818s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504334443 (601h4m11.387748073s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504879053 (601h4m11.388292692s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505024311 (601h4m11.38843794s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505615030 (601h4m11.389028658s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505818478 (601h4m11.389232111s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506194275 (601h4m11.389607905s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506684236 (601h4m11.390097863s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507042490 (601h4m11.390456119s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507352345 (601h4m11.390765974s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507641444 (601h4m11.391055073s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507920530 (601h4m11.391334158s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:12.073767728 (601h4m11.957181359s) [upload=480599]: Next returned nil segment Jul 18 10:15:12.073789153 (601h4m11.95720279s) [upload=480599]: Waiting for error group managing segments... Jul 18 10:15:12.220745306 (601h4m12.104158944s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.221065650 (601h4m12.104479281s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.223269203 (601h4m12.10668284s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.225214965 (601h4m12.108628586s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.233054290 (601h4m12.116467916s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.236960016 (601h4m12.12037364s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.240699624 (601h4m12.12411326s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.241728084 (601h4m12.125141702s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.244959034 (601h4m12.128372651s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.374213489 (601h4m12.257627126s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.388697463 (601h4m12.272111089s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.461880149 (601h4m12.345293763s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.743207026 (601h4m12.626620643s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:16:11.024574729 (601h5m10.907988355s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024635598 (601h5m10.908049211s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12NKFSj1P8HBhfYrYPTsj5hANnpp3FZmMkuWvqpS7MxKR3k6Bq, address:77.90.31.10:4526): protocol: write tcp 139.59.144.22:49184->77.90.31.10:4526: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024688821 (601h5m10.908102433s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK, address:77.90.31.21:4905): protocol: rpc: dial tcp 77.90.31.21:4905: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024730241 (601h5m10.908143871s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r, address:77.90.31.16:4745): protocol: rpc: dial tcp 77.90.31.16:4745: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024791318 (601h5m10.908204944s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:152bVnKGB6XVkvkjrWDsivCMxEPXq3tesh1srTzXZBcuEohFDo, address:77.90.31.15:4728): protocol: write tcp 139.59.144.22:45178->77.90.31.15:4728: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024827506 (601h5m10.908241136s) [seg_pos={0 0}, upload=480599]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 10:16:11.138404604 (601h5m11.02181823s) [upload=480599]: Done uploading segments... Jul 18 10:16:11.138432097 (601h5m11.02184571s) [upload=480599]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.563511102s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.60907273s FAIL (2025-07-18 10:17:03 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 599]: Uploading segments... Jul 18 10:15:11.294485085 (601h4m11.177898712s) [upload=480599]: Got next segment. Inline: false Jul 18 10:15:11.294544272 (601h4m11.177957885s) [upload=480599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:15:11.294550582 (601h4m11.177964195s) [upload=480599]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:15:11.501406888 (601h4m11.384820518s) [seg_pos={0 0}, upload=480599]: Begin upload segment... Jul 18 10:15:11.501484361 (601h4m11.384897977s) [seg_pos={0 0}, upload=480599]: Done begin upload segment. Jul 18 10:15:11.501520374 (601h4m11.384934003s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.501569822 (601h4m11.384983455s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502348936 (601h4m11.385762573s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502573055 (601h4m11.38598669s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503277563 (601h4m11.386691202s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503364061 (601h4m11.386777691s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504187187 (601h4m11.387600818s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504334443 (601h4m11.387748073s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504879053 (601h4m11.388292692s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505024311 (601h4m11.38843794s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505615030 (601h4m11.389028658s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505818478 (601h4m11.389232111s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506194275 (601h4m11.389607905s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506684236 (601h4m11.390097863s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507042490 (601h4m11.390456119s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507352345 (601h4m11.390765974s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507641444 (601h4m11.391055073s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507920530 (601h4m11.391334158s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:12.073767728 (601h4m11.957181359s) [upload=480599]: Next returned nil segment Jul 18 10:15:12.073789153 (601h4m11.95720279s) [upload=480599]: Waiting for error group managing segments... Jul 18 10:15:12.220745306 (601h4m12.104158944s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.221065650 (601h4m12.104479281s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.223269203 (601h4m12.10668284s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.225214965 (601h4m12.108628586s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.233054290 (601h4m12.116467916s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.236960016 (601h4m12.12037364s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.240699624 (601h4m12.12411326s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.241728084 (601h4m12.125141702s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.244959034 (601h4m12.128372651s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.374213489 (601h4m12.257627126s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.388697463 (601h4m12.272111089s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.461880149 (601h4m12.345293763s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.743207026 (601h4m12.626620643s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:16:11.024574729 (601h5m10.907988355s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024635598 (601h5m10.908049211s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12NKFSj1P8HBhfYrYPTsj5hANnpp3FZmMkuWvqpS7MxKR3k6Bq, address:77.90.31.10:4526): protocol: write tcp 139.59.144.22:49184->77.90.31.10:4526: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024688821 (601h5m10.908102433s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK, address:77.90.31.21:4905): protocol: rpc: dial tcp 77.90.31.21:4905: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024730241 (601h5m10.908143871s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r, address:77.90.31.16:4745): protocol: rpc: dial tcp 77.90.31.16:4745: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024791318 (601h5m10.908204944s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:152bVnKGB6XVkvkjrWDsivCMxEPXq3tesh1srTzXZBcuEohFDo, address:77.90.31.15:4728): protocol: write tcp 139.59.144.22:45178->77.90.31.15:4728: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024827506 (601h5m10.908241136s) [seg_pos={0 0}, upload=480599]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 10:16:11.138404604 (601h5m11.02181823s) [upload=480599]: Done uploading segments... Jul 18 10:16:11.138432097 (601h5m11.02184571s) [upload=480599]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.609145071s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.413271514s FAIL (2025-07-18 10:16:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.413300493s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.524760374s FAIL (2025-07-18 10:16:26 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 599]: Uploading segments... Jul 18 10:15:11.294485085 (601h4m11.177898712s) [upload=480599]: Got next segment. Inline: false Jul 18 10:15:11.294544272 (601h4m11.177957885s) [upload=480599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:15:11.294550582 (601h4m11.177964195s) [upload=480599]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:15:11.501406888 (601h4m11.384820518s) [seg_pos={0 0}, upload=480599]: Begin upload segment... Jul 18 10:15:11.501484361 (601h4m11.384897977s) [seg_pos={0 0}, upload=480599]: Done begin upload segment. Jul 18 10:15:11.501520374 (601h4m11.384934003s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.501569822 (601h4m11.384983455s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502348936 (601h4m11.385762573s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502573055 (601h4m11.38598669s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503277563 (601h4m11.386691202s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503364061 (601h4m11.386777691s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504187187 (601h4m11.387600818s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504334443 (601h4m11.387748073s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504879053 (601h4m11.388292692s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505024311 (601h4m11.38843794s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505615030 (601h4m11.389028658s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505818478 (601h4m11.389232111s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506194275 (601h4m11.389607905s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506684236 (601h4m11.390097863s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507042490 (601h4m11.390456119s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507352345 (601h4m11.390765974s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507641444 (601h4m11.391055073s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507920530 (601h4m11.391334158s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:12.073767728 (601h4m11.957181359s) [upload=480599]: Next returned nil segment Jul 18 10:15:12.073789153 (601h4m11.95720279s) [upload=480599]: Waiting for error group managing segments... Jul 18 10:15:12.220745306 (601h4m12.104158944s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.221065650 (601h4m12.104479281s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.223269203 (601h4m12.10668284s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.225214965 (601h4m12.108628586s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.233054290 (601h4m12.116467916s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.236960016 (601h4m12.12037364s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.240699624 (601h4m12.12411326s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.241728084 (601h4m12.125141702s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.244959034 (601h4m12.128372651s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.374213489 (601h4m12.257627126s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.388697463 (601h4m12.272111089s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.461880149 (601h4m12.345293763s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.743207026 (601h4m12.626620643s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:16:11.024574729 (601h5m10.907988355s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024635598 (601h5m10.908049211s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12NKFSj1P8HBhfYrYPTsj5hANnpp3FZmMkuWvqpS7MxKR3k6Bq, address:77.90.31.10:4526): protocol: write tcp 139.59.144.22:49184->77.90.31.10:4526: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024688821 (601h5m10.908102433s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK, address:77.90.31.21:4905): protocol: rpc: dial tcp 77.90.31.21:4905: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024730241 (601h5m10.908143871s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r, address:77.90.31.16:4745): protocol: rpc: dial tcp 77.90.31.16:4745: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024791318 (601h5m10.908204944s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:152bVnKGB6XVkvkjrWDsivCMxEPXq3tesh1srTzXZBcuEohFDo, address:77.90.31.15:4728): protocol: write tcp 139.59.144.22:45178->77.90.31.15:4728: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024827506 (601h5m10.908241136s) [seg_pos={0 0}, upload=480599]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 10:16:11.138404604 (601h5m11.02181823s) [upload=480599]: Done uploading segments... Jul 18 10:16:11.138432097 (601h5m11.02184571s) [upload=480599]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.524852689s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.116118237s FAIL (2025-07-18 10:16:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 599]: Uploading segments... Jul 18 10:15:11.294485085 (601h4m11.177898712s) [upload=480599]: Got next segment. Inline: false Jul 18 10:15:11.294544272 (601h4m11.177957885s) [upload=480599]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 10:15:11.294550582 (601h4m11.177964195s) [upload=480599]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 10:15:11.501406888 (601h4m11.384820518s) [seg_pos={0 0}, upload=480599]: Begin upload segment... Jul 18 10:15:11.501484361 (601h4m11.384897977s) [seg_pos={0 0}, upload=480599]: Done begin upload segment. Jul 18 10:15:11.501520374 (601h4m11.384934003s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.501569822 (601h4m11.384983455s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502348936 (601h4m11.385762573s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.502573055 (601h4m11.38598669s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503277563 (601h4m11.386691202s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.503364061 (601h4m11.386777691s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504187187 (601h4m11.387600818s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504334443 (601h4m11.387748073s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.504879053 (601h4m11.388292692s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505024311 (601h4m11.38843794s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505615030 (601h4m11.389028658s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.505818478 (601h4m11.389232111s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506194275 (601h4m11.389607905s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.506684236 (601h4m11.390097863s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507042490 (601h4m11.390456119s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507352345 (601h4m11.390765974s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507641444 (601h4m11.391055073s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:11.507920530 (601h4m11.391334158s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Uploading piece... Jul 18 10:15:12.073767728 (601h4m11.957181359s) [upload=480599]: Next returned nil segment Jul 18 10:15:12.073789153 (601h4m11.95720279s) [upload=480599]: Waiting for error group managing segments... Jul 18 10:15:12.220745306 (601h4m12.104158944s) [noise=true , address=45.91.116.13:4165 , piece_id=HTDTXYPQCHJ44P6TZK5NHBAA6VLQ3ZAPGICXWNAIY7XTAJFPXFLQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.221065650 (601h4m12.104479281s) [noise=true , address=45.91.116.9:4290 , piece_id=V577LFCRNEMU5O2MVJIWZFCQKEP73OPTSYTJGURWU7LGCNR5A3MQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.223269203 (601h4m12.10668284s) [noise=true , address=45.91.116.14:4202 , piece_id=G66FPECBOW7U6THNNJQ7C5FGSFI6HRSNUPSK2QABRCHNBHAFJMVQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.225214965 (601h4m12.108628586s) [noise=true , address=77.90.31.18:4817 , piece_id=RZDH6XKPAJLMA5IVO6MYRKZRKFVA43CY6QMLV3Y7AXA7ZL6PBXBA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.233054290 (601h4m12.116467916s) [noise=true , address=45.91.116.11:4134 , piece_id=6GOQ3JZ2LO6TTXTEQRGGDPRESM5WN7VYHJ6I64EBD7DSLB5WFINQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.236960016 (601h4m12.12037364s) [noise=true , address=45.91.116.7:4018 , piece_id=5VSJRU2YLNKO4N7HN3E6XQAI5MUAPTJESGYPQH2WYFK6SXM4TNOQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.240699624 (601h4m12.12411326s) [noise=true , address=77.90.31.14:4681 , piece_id=AAVMUTZDZPL4OAUFWYBDVVEOB4QD6QXVUU3TJFJTQRXXNYIXO5UQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.241728084 (601h4m12.125141702s) [noise=true , address=45.91.116.4:4961 , piece_id=SNGSTP247D5AOHP3XSZT2STVOSQODBBG527SZSM2UFIZT6AN7ZZQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.244959034 (601h4m12.128372651s) [noise=true , address=77.90.31.19:4869 , piece_id=X3RQKYZNYVNQ6FQPEJWF7JSP73YCZOZCNI2BZAUODXBUWY6JM23Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.374213489 (601h4m12.257627126s) [noise=true , address=45.91.95.2:4029 , piece_id=NVUFZDB5CC72ITPBTYUXI67ZCB37YYEHQQDFKD4M4FH47OYPI6OQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.388697463 (601h4m12.272111089s) [noise=true , address=79.127.220.97:4384 , piece_id=YTWOECX23IN7XDUXTUIMJ2LWT2SVKHIBFJMJ4DUXF73WR3USMO4Q, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.461880149 (601h4m12.345293763s) [noise=true , address=45.91.95.4:4034 , piece_id=LUDQUXHNRGSIYJKGIOPWDAXYPQNPWCJ2CRXAJVTEAJJVGSSYP6DA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:15:12.743207026 (601h4m12.626620643s) [noise=true , address=79.127.205.235:4690 , piece_id=KGMPALZUII5C5ZBGFIQ5DUX4D74ZIBLX453AHAEONK6PJCIVZBRA, seg_pos={0 0}, upload=480599]: Done uploading piece. err: <nil> Jul 18 10:16:11.024574729 (601h5m10.907988355s) [noise=true , address=77.90.31.17:4799 , piece_id=LJMMDBRARSETLLBK7CG76OO4EDI3IMQJ77BH2IGDDIEKSWZR24VQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024635598 (601h5m10.908049211s) [noise=true , address=77.90.31.10:4526 , piece_id=KSQNNDUQZ4H2E2LUI2D273BS2ZA7KVL5JLZ26LXNMF2P2PKKVSHQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12NKFSj1P8HBhfYrYPTsj5hANnpp3FZmMkuWvqpS7MxKR3k6Bq, address:77.90.31.10:4526): protocol: write tcp 139.59.144.22:49184->77.90.31.10:4526: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024688821 (601h5m10.908102433s) [noise=true , address=77.90.31.21:4905 , piece_id=V2FOQZSC6BFX32AW5GC2Z6L5ZH6YYWFOBJVZWE6TUSCD3HAITXPQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK, address:77.90.31.21:4905): protocol: rpc: dial tcp 77.90.31.21:4905: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024730241 (601h5m10.908143871s) [noise=true , address=77.90.31.16:4745 , piece_id=O4LBEBW7DJZE436DA4I5N4JLRYICMZELZRJPEFVJTTK3CDO2ZWXQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:12sFKft9P2avVAwrZC4fcCRwuWbFT7q9bCwLmumHNmSiqxHDR7r, address:77.90.31.16:4745): protocol: rpc: dial tcp 77.90.31.16:4745: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024791318 (601h5m10.908204944s) [noise=true , address=77.90.31.15:4728 , piece_id=OZMJCIHTZ6IDSVI7ZCVCNT4H5JLMEGUOK2YNUDPQPXUUTW2SYCNQ, seg_pos={0 0}, upload=480599]: Done uploading piece. err: ecclient: upload failed (node:152bVnKGB6XVkvkjrWDsivCMxEPXq3tesh1srTzXZBcuEohFDo, address:77.90.31.15:4728): protocol: write tcp 139.59.144.22:45178->77.90.31.15:4728: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 10:16:11.024827506 (601h5m10.908241136s) [seg_pos={0 0}, upload=480599]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 10:16:11.138404604 (601h5m11.02181823s) [upload=480599]: Done uploading segments... Jul 18 10:16:11.138432097 (601h5m11.02184571s) [upload=480599]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.116150491s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.32935488s FAIL (2025-07-18 10:16:06 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.329385193s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.320495479s FAIL (2025-07-18 10:15:17 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.320524684s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.380998043s FAIL (2025-07-18 10:14:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.381027086s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.337179999s FAIL (2025-07-18 10:14:29 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.337208441s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.421655231s FAIL (2025-07-18 10:13:38 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.421685733s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.44074797s FAIL (2025-07-18 10:12:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.440780742s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.374621892s FAIL (2025-07-18 10:11:17 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.374649118s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.386532091s FAIL (2025-07-18 10:10:06 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.386567161s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.341050932s FAIL (2025-07-18 10:08:53 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.341078496s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.29466998s FAIL (2025-07-18 10:07:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.294699036s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.323735427s FAIL (2025-07-18 10:07:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.323774345s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.366259837s FAIL (2025-07-18 10:06:31 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.366290181s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.354338382s FAIL (2025-07-18 10:05:27 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.354371611s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.368172328s FAIL (2025-07-18 10:04:16 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.368202325s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.425386848s FAIL (2025-07-18 10:03:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.4254194s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.407164576s FAIL (2025-07-18 10:02:48 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.407192786s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.396260628s FAIL (2025-07-18 10:02:10 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.396304514s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.398143562s FAIL (2025-07-18 10:01:16 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.398173546s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.391198312s FAIL (2025-07-18 10:00:47 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.391228299s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.327434374s FAIL (2025-07-18 09:59:37 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.327472352s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.36426397s FAIL (2025-07-18 09:58:31 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.3642999s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.3950914s FAIL (2025-07-18 09:57:29 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.395119394s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.544298305s FAIL (2025-07-18 09:57:08 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.54444121s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.497844129s FAIL (2025-07-18 09:56:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.497877925s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.3704464s FAIL (2025-07-18 09:55:18 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.3704785s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.316394529s FAIL (2025-07-18 09:54:51 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.316422407s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.364528049s FAIL (2025-07-18 09:53:46 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.36457157s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.487217119s FAIL (2025-07-18 09:53:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.487244671s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.347502068s FAIL (2025-07-18 09:52:51 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.347533838s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.520508586s FAIL (2025-07-18 09:52:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.520536091s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.455721671s FAIL (2025-07-18 09:51:10 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.45575583s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.301135466s FAIL (2025-07-18 09:50:48 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.301190814s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.390300647s FAIL (2025-07-18 09:50:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.390330806s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.381664503s FAIL (2025-07-18 09:49:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.381692359s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.316085439s FAIL (2025-07-18 09:48:52 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.31618264s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.296465927s FAIL (2025-07-18 09:48:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.296499576s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.6207437s FAIL (2025-07-18 09:47:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.620772455s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.11504776s FAIL (2025-07-18 09:47:42 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== eg_pos={0 0}, upload=480208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: expected piece hash; context canceled; EOF Jul 18 09:46:29.852244705 (600h35m29.735658318s) [seg_pos={0 0}, upload=480208]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 09:46:29.852337980 (600h35m29.735751616s) [upload=480208]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 09:46:29.852343363 (600h35m29.735757s) [upload=480208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 09:46:30.018458479 (600h35m29.901872113s) [upload=480208]: Done uploading segments... Jul 18 09:46:30.018482701 (600h35m29.901896329s) [upload=480208]: Upload finished. err: <nil> Jul 18 09:47:12.249795116 (600h36m12.133208733s) [upload=480219]: Starting upload Jul 18 09:47:12.249858020 (600h36m12.133271649s) [upload=480219]: Done starting upload Jul 18 09:47:12.249967722 (600h36m12.133381349s) [upload=480219]: Uploading segments... Jul 18 09:47:12.250258050 (600h36m12.133671676s) [upload=480219]: Got next segment. Inline: false Jul 18 09:47:12.250305440 (600h36m12.133719067s) [upload=480219]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 09:47:12.250311644 (600h36m12.13372527s) [upload=480219]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 09:47:12.360334967 (600h36m12.243748582s) [seg_pos={0 0}, upload=480219]: Begin upload segment... Jul 18 09:47:12.360398232 (600h36m12.243811858s) [seg_pos={0 0}, upload=480219]: Done begin upload segment. Jul 18 09:47:12.360430446 (600h36m12.243844075s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360442158 (600h36m12.243855784s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360844768 (600h36m12.244258405s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.360921527 (600h36m12.244335154s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361231814 (600h36m12.244645447s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361272926 (600h36m12.244686561s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.361573071 (600h36m12.244986705s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362070831 (600h36m12.245484467s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362578404 (600h36m12.24599204s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.362639615 (600h36m12.24605325s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363118673 (600h36m12.246532308s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.363610806 (600h36m12.247024439s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364064565 (600h36m12.247478194s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364390745 (600h36m12.247804371s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.364738064 (600h36m12.248151694s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.365227530 (600h36m12.248641159s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Uploading piece... Jul 18 09:47:12.977845102 (600h36m12.861258716s) [upload=480219]: Next returned nil segment Jul 18 09:47:12.977863037 (600h36m12.86127665s) [upload=480219]: Waiting for error group managing segments... Jul 18 09:47:13.101023422 (600h36m12.984437052s) [noise=true , address=77.90.31.17:4772 , piece_id=MNJSLMK3AYBBCNNGB2XCEJVK6GOZON5XNFTSAJ7WZFDVDLYYHMYA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.112120257 (600h36m12.99553389s) [noise=true , address=45.91.116.4:4937 , piece_id=PDRF44GF42EBXT5WGJU2FWPW2PIIAJ7BQDYMYPICE4TPHOIMVRNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121688728 (600h36m13.005102347s) [noise=true , address=45.91.116.4:4940 , piece_id=6VYCYZAAU43AU43LELYGEF43C6PETFOPDPYAWA4M4LN46I2SYWXA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.121982112 (600h36m13.005395726s) [noise=true , address=45.91.116.11:4118 , piece_id=PCHVHKJYKVF3RO3LCNUXFCEHKBNNLQBBRZISAHGKHRAEQQ4BRJVQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123111038 (600h36m13.006524658s) [noise=true , address=77.90.31.16:4734 , piece_id=TMPHZML4KOSCYFBC7S7CYAL2MFXF77YKOSFW73UA7QBU4ZI4VQNA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.123623025 (600h36m13.007036645s) [noise=true , address=45.91.116.13:4153 , piece_id=M2FJOC4YSD5YU6NUKQMFTDLEVVCGSFXD42UBFSWFKPDK6RQKPMBA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.124578753 (600h36m13.007992377s) [noise=true , address=45.91.116.6:4974 , piece_id=5AD6RWWSC6PAGM7CCGYA6LVOY4EHIAZ23RNIG6232NUC3MNWCA6A, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.128637729 (600h36m13.012051342s) [noise=true , address=45.91.116.14:4190 , piece_id=I3NIKZIQUGPLUGRUB52UTINRQVTXED2OMZKF5ZKK2PUIEA2OKXTQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.131102604 (600h36m13.014516217s) [noise=true , address=45.91.116.9:4263 , piece_id=Y6JBE25Y5FIJJZMSCOGKMWGSKJGQ7CQNETGEOJTGCTB3K45VIAZQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.132579066 (600h36m13.015992698s) [noise=true , address=77.90.31.18:4806 , piece_id=I6HTRAOTH5CKEY6POVTA3RMVMKXIFTUAGCKRF32W7YSTULSOKKBQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.142520333 (600h36m13.025933952s) [noise=true , address=77.90.31.13:4628 , piece_id=6MQPSFO2NC3WUHLT3EV2P2MTQ6662V6RLFMDJNWJODEWUKKCDKPA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:13.158118396 (600h36m13.041532015s) [noise=true , address=104.36.82.4:4803 , piece_id=WSVRUI2UH7HYBGKVSPJQWFKTTBKY4C2RGLS532ECHQXAYBIKGIRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: <nil> Jul 18 09:47:41.976241305 (600h36m41.859654924s) [noise=true , address=77.90.31.13:4627 , piece_id=VE4A2OPBOCZKXAEOKEQBXEKAXH4MMUVWUC7G4B4FUF26O3MS3VRA, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:48966->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976424161 (600h36m41.859837775s) [noise=true , address=77.90.31.21:4877 , piece_id=GO3ASSKXAGKOVQAGR2C5QSO7ZZHD53PXNILFEZ2ZIMAEG5E6CZNQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976474506 (600h36m41.859888139s) [noise=true , address=77.90.31.10:4519 , piece_id=HQMJ62CTMCVMDMOMZKVBJVOXD3FAYBQ5ZUWUUB22OZKZDFOGNJ3Q, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:40678->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976493548 (600h36m41.859907161s) [noise=true , address=77.90.31.14:4661 , piece_id=KOZPREPIRIJ33RXIVT3MELOHCLF3BNK52K43J2TYD6NUF27SZRFQ, seg_pos={0 0}, upload=480219]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 09:47:41.976522792 (600h36m41.859936418s) [seg_pos={0 0}, upload=480219]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 09:47:42.089123138 (600h36m41.972536754s) [upload=480219]: Done uploading segments... Jul 18 09:47:42.089150713 (600h36m41.972564329s) [upload=480219]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.115077369s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.573656919s FAIL (2025-07-18 03:01:51 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 0468 (593h2m18.628194085s) [upload=474167]: Got next segment. Inline: false Jul 18 02:13:18.744827419 (593h2m18.628241045s) [upload=474167]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 02:13:18.744833270 (593h2m18.628246896s) [upload=474167]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 02:13:18.944247732 (593h2m18.827661359s) [seg_pos={0 0}, upload=474167]: Begin upload segment... Jul 18 02:13:18.944300780 (593h2m18.827714397s) [seg_pos={0 0}, upload=474167]: Done begin upload segment. Jul 18 02:13:18.944327501 (593h2m18.827741131s) [noise=true , address=64.49.13.140:4514 , piece_id=AHOWVODFU6B3AAANVVFU4QZDTRXYMEXWAPHMIUBL445N4QBNBDPA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.944748561 (593h2m18.82816219s) [noise=true , address=104.36.82.40:4965 , piece_id=QVBRNABGNUDALSD6YSERJIGPRAVMRCBNZWD6S3L7UE7UMDINXIZQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945029770 (593h2m18.828443399s) [noise=true , address=104.36.82.5:4866 , piece_id=DN7REXMIHHAYHR3YV4YZ7RIPVWMR42AX6HL46XILWSWHQTXDN2WA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945305573 (593h2m18.828719199s) [noise=true , address=77.90.31.15:4707 , piece_id=HEGKDFTKYYIKXRMDOKXOJRTSMAUUBL2D7UBCINKSKQV5KNNRNW3A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945587945 (593h2m18.829001572s) [noise=true , address=79.127.219.51:4197 , piece_id=C5PCVWGRXFLMSKY3JIQ34XAWC5CY4JR3XPPSGQ5POIFTA2AVM52Q, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945905736 (593h2m18.829319373s) [noise=true , address=45.91.116.11:4122 , piece_id=2N2PKPMW7MMQKEGBJ5JALY6GA6PQ7H2Z2RV6BRSOTOLLDWGGWEWA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946318615 (593h2m18.829732242s) [noise=true , address=45.91.95.4:4023 , piece_id=MHI6MJN3IONG7D6VL5JDWW7J7TZQ5P55TXV6RX6MZZ7M5DYWEOTQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946635972 (593h2m18.830049598s) [noise=true , address=79.127.205.234:4617 , piece_id=OXKUU4PF5ZSYD2LTNHJ367GJXCQXDRNGUY2RH3UI7ANAZKNGHE3Q, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946932847 (593h2m18.830346512s) [noise=true , address=77.90.31.10:4546 , piece_id=2VKHQSWRL5HYCWMY6463GSMQDOV3GF2GQQF5DKWTA3QSVKG3G2QQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947207379 (593h2m18.830621008s) [noise=true , address=77.90.31.11:4575 , piece_id=3YZHHBMW2TUSEH5GX7BQF65PXL7ZVUA646JRNBFF3NTCS7BCEQPA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947511937 (593h2m18.830925567s) [noise=true , address=45.91.116.8:4075 , piece_id=R63TYEY34PGAQB3QZ3EKCVBZJ6PY3XRZ7FZMPADWGLAWSRR3BV7A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947896979 (593h2m18.831310619s) [noise=true , address=45.91.116.7:4013 , piece_id=IOSFQDAAUSXBLF7KJFK36SAPUFTIOUOGD65K3KNRUCKMG2NV5M6A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948220274 (593h2m18.831633901s) [noise=true , address=45.91.116.12:4236 , piece_id=LC7EETGY3NJHRVPE2TFBJWPGFCAMOFV47R2A3TQEIWJ5N6V4264A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948536793 (593h2m18.831950434s) [noise=true , address=77.90.31.13:4645 , piece_id=6AGW7BEMYHIL7BOAUETZWEHJM36HUBJ2HYPNXYPG3FHC2KJYKS2A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948900904 (593h2m18.832314537s) [noise=true , address=45.91.116.5:4315 , piece_id=7B4KSGICA5N2MM2TO52UHHKYUOXS2AQHYORMC2TC6RCYAODHV4HQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949201483 (593h2m18.832615112s) [noise=true , address=79.127.205.233:4655 , piece_id=K7FWZFKAEWHXTY5QOHMRUNIS4VBHG6OOVLXBF7ZYWV5LRYSGMVXA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949472498 (593h2m18.832886128s) [noise=true , address=77.90.31.18:4817 , piece_id=7FZU2HQAWBWMSZ2ZHKLPJRPUKQHNSIXF3O2DXNIC5E3BNKZQ7MMA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949792417 (593h2m18.833206048s) [noise=true , address=45.91.95.2:4027 , piece_id=O6OHEXXYEZVJYIQSQRAJ4P225SMCRRERKFZD5SPPSJRLSSH7UFMA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:19.506882340 (593h2m19.390295955s) [upload=474167]: Next returned nil segment Jul 18 02:13:19.506923123 (593h2m19.390336751s) [upload=474167]: Waiting for error group managing segments... Jul 18 02:13:19.666828456 (593h2m19.550242074s) [noise=true , address=45.91.116.5:4315 , piece_id=7B4KSGICA5N2MM2TO52UHHKYUOXS2AQHYORMC2TC6RCYAODHV4HQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.669997440 (593h2m19.55341106s) [noise=true , address=45.91.116.8:4075 , piece_id=R63TYEY34PGAQB3QZ3EKCVBZJ6PY3XRZ7FZMPADWGLAWSRR3BV7A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.678533346 (593h2m19.561946983s) [noise=true , address=45.91.116.7:4013 , piece_id=IOSFQDAAUSXBLF7KJFK36SAPUFTIOUOGD65K3KNRUCKMG2NV5M6A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.688823710 (593h2m19.57223733s) [noise=true , address=79.127.219.51:4197 , piece_id=C5PCVWGRXFLMSKY3JIQ34XAWC5CY4JR3XPPSGQ5POIFTA2AVM52Q, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.688899040 (593h2m19.572312661s) [noise=true , address=45.91.116.12:4236 , piece_id=LC7EETGY3NJHRVPE2TFBJWPGFCAMOFV47R2A3TQEIWJ5N6V4264A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.692235863 (593h2m19.575649484s) [noise=true , address=45.91.116.11:4122 , piece_id=2N2PKPMW7MMQKEGBJ5JALY6GA6PQ7H2Z2RV6BRSOTOLLDWGGWEWA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.696462183 (593h2m19.579875811s) [noise=true , address=104.36.82.40:4965 , piece_id=QVBRNABGNUDALSD6YSERJIGPRAVMRCBNZWD6S3L7UE7UMDINXIZQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.813900946 (593h2m19.697314563s) [noise=true , address=45.91.95.4:4023 , piece_id=MHI6MJN3IONG7D6VL5JDWW7J7TZQ5P55TXV6RX6MZZ7M5DYWEOTQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.821077860 (593h2m19.70449148s) [noise=true , address=45.91.95.2:4027 , piece_id=O6OHEXXYEZVJYIQSQRAJ4P225SMCRRERKFZD5SPPSJRLSSH7UFMA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.204635402 (593h2m20.088049022s) [noise=true , address=64.49.13.140:4514 , piece_id=AHOWVODFU6B3AAANVVFU4QZDTRXYMEXWAPHMIUBL445N4QBNBDPA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.284751010 (593h2m20.168164626s) [noise=true , address=79.127.205.233:4655 , piece_id=K7FWZFKAEWHXTY5QOHMRUNIS4VBHG6OOVLXBF7ZYWV5LRYSGMVXA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.285897562 (593h2m20.169311174s) [noise=true , address=79.127.205.234:4617 , piece_id=OXKUU4PF5ZSYD2LTNHJ367GJXCQXDRNGUY2RH3UI7ANAZKNGHE3Q, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:22.157138533 (593h2m22.040552152s) [noise=true , address=104.36.82.5:4866 , piece_id=DN7REXMIHHAYHR3YV4YZ7RIPVWMR42AX6HL46XILWSWHQTXDN2WA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:14:18.469416431 (593h3m18.352830058s) [noise=true , address=77.90.31.15:4707 , piece_id=HEGKDFTKYYIKXRMDOKXOJRTSMAUUBL2D7UBCINKSKQV5KNNRNW3A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL, address:77.90.31.15:4707): protocol: rpc: dial tcp 77.90.31.15:4707: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469487502 (593h3m18.352901118s) [noise=true , address=77.90.31.10:4546 , piece_id=2VKHQSWRL5HYCWMY6463GSMQDOV3GF2GQQF5DKWTA3QSVKG3G2QQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1jjRZPZ6TDPepFAmvv81dREkDJDrXqeu9wqzNYkeaGemFFdxwK, address:77.90.31.10:4546): protocol: write tcp 139.59.144.22:58640->77.90.31.10:4546: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469495352 (593h3m18.352908971s) [noise=true , address=77.90.31.18:4817 , piece_id=7FZU2HQAWBWMSZ2ZHKLPJRPUKQHNSIXF3O2DXNIC5E3BNKZQ7MMA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:12Qv5LBuANP9vS2vbsVNrJ7Mkc3SqXwTNCBzLvN955RHFKQVv5x, address:77.90.31.18:4817): protocol: rpc: dial tcp 77.90.31.18:4817: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469551424 (593h3m18.35296505s) [noise=true , address=77.90.31.13:4645 , piece_id=6AGW7BEMYHIL7BOAUETZWEHJM36HUBJ2HYPNXYPG3FHC2KJYKS2A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg, address:77.90.31.13:4645): protocol: write tcp 139.59.144.22:33516->77.90.31.13:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469590566 (593h3m18.353004192s) [noise=true , address=77.90.31.11:4575 , piece_id=3YZHHBMW2TUSEH5GX7BQF65PXL7ZVUA646JRNBFF3NTCS7BCEQPA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc, address:77.90.31.11:4575): protocol: write tcp 139.59.144.22:46706->77.90.31.11:4575: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Jul 18 02:14:18.469617916 (593h3m18.353031533s) [seg_pos={0 0}, upload=474167]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 02:14:18.582376941 (593h3m18.46579056s) [upload=474167]: Done uploading segments... Jul 18 02:14:18.582410612 (593h3m18.465824233s) [upload=474167]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.573686168s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 2.612767904s FAIL (2025-07-18 03:00:39 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 0468 (593h2m18.628194085s) [upload=474167]: Got next segment. Inline: false Jul 18 02:13:18.744827419 (593h2m18.628241045s) [upload=474167]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 02:13:18.744833270 (593h2m18.628246896s) [upload=474167]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 02:13:18.944247732 (593h2m18.827661359s) [seg_pos={0 0}, upload=474167]: Begin upload segment... Jul 18 02:13:18.944300780 (593h2m18.827714397s) [seg_pos={0 0}, upload=474167]: Done begin upload segment. Jul 18 02:13:18.944327501 (593h2m18.827741131s) [noise=true , address=64.49.13.140:4514 , piece_id=AHOWVODFU6B3AAANVVFU4QZDTRXYMEXWAPHMIUBL445N4QBNBDPA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.944748561 (593h2m18.82816219s) [noise=true , address=104.36.82.40:4965 , piece_id=QVBRNABGNUDALSD6YSERJIGPRAVMRCBNZWD6S3L7UE7UMDINXIZQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945029770 (593h2m18.828443399s) [noise=true , address=104.36.82.5:4866 , piece_id=DN7REXMIHHAYHR3YV4YZ7RIPVWMR42AX6HL46XILWSWHQTXDN2WA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945305573 (593h2m18.828719199s) [noise=true , address=77.90.31.15:4707 , piece_id=HEGKDFTKYYIKXRMDOKXOJRTSMAUUBL2D7UBCINKSKQV5KNNRNW3A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945587945 (593h2m18.829001572s) [noise=true , address=79.127.219.51:4197 , piece_id=C5PCVWGRXFLMSKY3JIQ34XAWC5CY4JR3XPPSGQ5POIFTA2AVM52Q, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945905736 (593h2m18.829319373s) [noise=true , address=45.91.116.11:4122 , piece_id=2N2PKPMW7MMQKEGBJ5JALY6GA6PQ7H2Z2RV6BRSOTOLLDWGGWEWA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946318615 (593h2m18.829732242s) [noise=true , address=45.91.95.4:4023 , piece_id=MHI6MJN3IONG7D6VL5JDWW7J7TZQ5P55TXV6RX6MZZ7M5DYWEOTQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946635972 (593h2m18.830049598s) [noise=true , address=79.127.205.234:4617 , piece_id=OXKUU4PF5ZSYD2LTNHJ367GJXCQXDRNGUY2RH3UI7ANAZKNGHE3Q, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946932847 (593h2m18.830346512s) [noise=true , address=77.90.31.10:4546 , piece_id=2VKHQSWRL5HYCWMY6463GSMQDOV3GF2GQQF5DKWTA3QSVKG3G2QQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947207379 (593h2m18.830621008s) [noise=true , address=77.90.31.11:4575 , piece_id=3YZHHBMW2TUSEH5GX7BQF65PXL7ZVUA646JRNBFF3NTCS7BCEQPA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947511937 (593h2m18.830925567s) [noise=true , address=45.91.116.8:4075 , piece_id=R63TYEY34PGAQB3QZ3EKCVBZJ6PY3XRZ7FZMPADWGLAWSRR3BV7A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947896979 (593h2m18.831310619s) [noise=true , address=45.91.116.7:4013 , piece_id=IOSFQDAAUSXBLF7KJFK36SAPUFTIOUOGD65K3KNRUCKMG2NV5M6A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948220274 (593h2m18.831633901s) [noise=true , address=45.91.116.12:4236 , piece_id=LC7EETGY3NJHRVPE2TFBJWPGFCAMOFV47R2A3TQEIWJ5N6V4264A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948536793 (593h2m18.831950434s) [noise=true , address=77.90.31.13:4645 , piece_id=6AGW7BEMYHIL7BOAUETZWEHJM36HUBJ2HYPNXYPG3FHC2KJYKS2A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948900904 (593h2m18.832314537s) [noise=true , address=45.91.116.5:4315 , piece_id=7B4KSGICA5N2MM2TO52UHHKYUOXS2AQHYORMC2TC6RCYAODHV4HQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949201483 (593h2m18.832615112s) [noise=true , address=79.127.205.233:4655 , piece_id=K7FWZFKAEWHXTY5QOHMRUNIS4VBHG6OOVLXBF7ZYWV5LRYSGMVXA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949472498 (593h2m18.832886128s) [noise=true , address=77.90.31.18:4817 , piece_id=7FZU2HQAWBWMSZ2ZHKLPJRPUKQHNSIXF3O2DXNIC5E3BNKZQ7MMA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949792417 (593h2m18.833206048s) [noise=true , address=45.91.95.2:4027 , piece_id=O6OHEXXYEZVJYIQSQRAJ4P225SMCRRERKFZD5SPPSJRLSSH7UFMA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:19.506882340 (593h2m19.390295955s) [upload=474167]: Next returned nil segment Jul 18 02:13:19.506923123 (593h2m19.390336751s) [upload=474167]: Waiting for error group managing segments... Jul 18 02:13:19.666828456 (593h2m19.550242074s) [noise=true , address=45.91.116.5:4315 , piece_id=7B4KSGICA5N2MM2TO52UHHKYUOXS2AQHYORMC2TC6RCYAODHV4HQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.669997440 (593h2m19.55341106s) [noise=true , address=45.91.116.8:4075 , piece_id=R63TYEY34PGAQB3QZ3EKCVBZJ6PY3XRZ7FZMPADWGLAWSRR3BV7A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.678533346 (593h2m19.561946983s) [noise=true , address=45.91.116.7:4013 , piece_id=IOSFQDAAUSXBLF7KJFK36SAPUFTIOUOGD65K3KNRUCKMG2NV5M6A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.688823710 (593h2m19.57223733s) [noise=true , address=79.127.219.51:4197 , piece_id=C5PCVWGRXFLMSKY3JIQ34XAWC5CY4JR3XPPSGQ5POIFTA2AVM52Q, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.688899040 (593h2m19.572312661s) [noise=true , address=45.91.116.12:4236 , piece_id=LC7EETGY3NJHRVPE2TFBJWPGFCAMOFV47R2A3TQEIWJ5N6V4264A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.692235863 (593h2m19.575649484s) [noise=true , address=45.91.116.11:4122 , piece_id=2N2PKPMW7MMQKEGBJ5JALY6GA6PQ7H2Z2RV6BRSOTOLLDWGGWEWA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.696462183 (593h2m19.579875811s) [noise=true , address=104.36.82.40:4965 , piece_id=QVBRNABGNUDALSD6YSERJIGPRAVMRCBNZWD6S3L7UE7UMDINXIZQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.813900946 (593h2m19.697314563s) [noise=true , address=45.91.95.4:4023 , piece_id=MHI6MJN3IONG7D6VL5JDWW7J7TZQ5P55TXV6RX6MZZ7M5DYWEOTQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.821077860 (593h2m19.70449148s) [noise=true , address=45.91.95.2:4027 , piece_id=O6OHEXXYEZVJYIQSQRAJ4P225SMCRRERKFZD5SPPSJRLSSH7UFMA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.204635402 (593h2m20.088049022s) [noise=true , address=64.49.13.140:4514 , piece_id=AHOWVODFU6B3AAANVVFU4QZDTRXYMEXWAPHMIUBL445N4QBNBDPA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.284751010 (593h2m20.168164626s) [noise=true , address=79.127.205.233:4655 , piece_id=K7FWZFKAEWHXTY5QOHMRUNIS4VBHG6OOVLXBF7ZYWV5LRYSGMVXA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.285897562 (593h2m20.169311174s) [noise=true , address=79.127.205.234:4617 , piece_id=OXKUU4PF5ZSYD2LTNHJ367GJXCQXDRNGUY2RH3UI7ANAZKNGHE3Q, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:22.157138533 (593h2m22.040552152s) [noise=true , address=104.36.82.5:4866 , piece_id=DN7REXMIHHAYHR3YV4YZ7RIPVWMR42AX6HL46XILWSWHQTXDN2WA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:14:18.469416431 (593h3m18.352830058s) [noise=true , address=77.90.31.15:4707 , piece_id=HEGKDFTKYYIKXRMDOKXOJRTSMAUUBL2D7UBCINKSKQV5KNNRNW3A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL, address:77.90.31.15:4707): protocol: rpc: dial tcp 77.90.31.15:4707: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469487502 (593h3m18.352901118s) [noise=true , address=77.90.31.10:4546 , piece_id=2VKHQSWRL5HYCWMY6463GSMQDOV3GF2GQQF5DKWTA3QSVKG3G2QQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1jjRZPZ6TDPepFAmvv81dREkDJDrXqeu9wqzNYkeaGemFFdxwK, address:77.90.31.10:4546): protocol: write tcp 139.59.144.22:58640->77.90.31.10:4546: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469495352 (593h3m18.352908971s) [noise=true , address=77.90.31.18:4817 , piece_id=7FZU2HQAWBWMSZ2ZHKLPJRPUKQHNSIXF3O2DXNIC5E3BNKZQ7MMA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:12Qv5LBuANP9vS2vbsVNrJ7Mkc3SqXwTNCBzLvN955RHFKQVv5x, address:77.90.31.18:4817): protocol: rpc: dial tcp 77.90.31.18:4817: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469551424 (593h3m18.35296505s) [noise=true , address=77.90.31.13:4645 , piece_id=6AGW7BEMYHIL7BOAUETZWEHJM36HUBJ2HYPNXYPG3FHC2KJYKS2A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg, address:77.90.31.13:4645): protocol: write tcp 139.59.144.22:33516->77.90.31.13:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469590566 (593h3m18.353004192s) [noise=true , address=77.90.31.11:4575 , piece_id=3YZHHBMW2TUSEH5GX7BQF65PXL7ZVUA646JRNBFF3NTCS7BCEQPA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc, address:77.90.31.11:4575): protocol: write tcp 139.59.144.22:46706->77.90.31.11:4575: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Jul 18 02:14:18.469617916 (593h3m18.353031533s) [seg_pos={0 0}, upload=474167]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 02:14:18.582376941 (593h3m18.46579056s) [upload=474167]: Done uploading segments... Jul 18 02:14:18.582410612 (593h3m18.465824233s) [upload=474167]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.612812252s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 2.48165307s FAIL (2025-07-18 02:59:27 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 0468 (593h2m18.628194085s) [upload=474167]: Got next segment. Inline: false Jul 18 02:13:18.744827419 (593h2m18.628241045s) [upload=474167]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 02:13:18.744833270 (593h2m18.628246896s) [upload=474167]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 02:13:18.944247732 (593h2m18.827661359s) [seg_pos={0 0}, upload=474167]: Begin upload segment... Jul 18 02:13:18.944300780 (593h2m18.827714397s) [seg_pos={0 0}, upload=474167]: Done begin upload segment. Jul 18 02:13:18.944327501 (593h2m18.827741131s) [noise=true , address=64.49.13.140:4514 , piece_id=AHOWVODFU6B3AAANVVFU4QZDTRXYMEXWAPHMIUBL445N4QBNBDPA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.944748561 (593h2m18.82816219s) [noise=true , address=104.36.82.40:4965 , piece_id=QVBRNABGNUDALSD6YSERJIGPRAVMRCBNZWD6S3L7UE7UMDINXIZQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945029770 (593h2m18.828443399s) [noise=true , address=104.36.82.5:4866 , piece_id=DN7REXMIHHAYHR3YV4YZ7RIPVWMR42AX6HL46XILWSWHQTXDN2WA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945305573 (593h2m18.828719199s) [noise=true , address=77.90.31.15:4707 , piece_id=HEGKDFTKYYIKXRMDOKXOJRTSMAUUBL2D7UBCINKSKQV5KNNRNW3A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945587945 (593h2m18.829001572s) [noise=true , address=79.127.219.51:4197 , piece_id=C5PCVWGRXFLMSKY3JIQ34XAWC5CY4JR3XPPSGQ5POIFTA2AVM52Q, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945905736 (593h2m18.829319373s) [noise=true , address=45.91.116.11:4122 , piece_id=2N2PKPMW7MMQKEGBJ5JALY6GA6PQ7H2Z2RV6BRSOTOLLDWGGWEWA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946318615 (593h2m18.829732242s) [noise=true , address=45.91.95.4:4023 , piece_id=MHI6MJN3IONG7D6VL5JDWW7J7TZQ5P55TXV6RX6MZZ7M5DYWEOTQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946635972 (593h2m18.830049598s) [noise=true , address=79.127.205.234:4617 , piece_id=OXKUU4PF5ZSYD2LTNHJ367GJXCQXDRNGUY2RH3UI7ANAZKNGHE3Q, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946932847 (593h2m18.830346512s) [noise=true , address=77.90.31.10:4546 , piece_id=2VKHQSWRL5HYCWMY6463GSMQDOV3GF2GQQF5DKWTA3QSVKG3G2QQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947207379 (593h2m18.830621008s) [noise=true , address=77.90.31.11:4575 , piece_id=3YZHHBMW2TUSEH5GX7BQF65PXL7ZVUA646JRNBFF3NTCS7BCEQPA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947511937 (593h2m18.830925567s) [noise=true , address=45.91.116.8:4075 , piece_id=R63TYEY34PGAQB3QZ3EKCVBZJ6PY3XRZ7FZMPADWGLAWSRR3BV7A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947896979 (593h2m18.831310619s) [noise=true , address=45.91.116.7:4013 , piece_id=IOSFQDAAUSXBLF7KJFK36SAPUFTIOUOGD65K3KNRUCKMG2NV5M6A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948220274 (593h2m18.831633901s) [noise=true , address=45.91.116.12:4236 , piece_id=LC7EETGY3NJHRVPE2TFBJWPGFCAMOFV47R2A3TQEIWJ5N6V4264A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948536793 (593h2m18.831950434s) [noise=true , address=77.90.31.13:4645 , piece_id=6AGW7BEMYHIL7BOAUETZWEHJM36HUBJ2HYPNXYPG3FHC2KJYKS2A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948900904 (593h2m18.832314537s) [noise=true , address=45.91.116.5:4315 , piece_id=7B4KSGICA5N2MM2TO52UHHKYUOXS2AQHYORMC2TC6RCYAODHV4HQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949201483 (593h2m18.832615112s) [noise=true , address=79.127.205.233:4655 , piece_id=K7FWZFKAEWHXTY5QOHMRUNIS4VBHG6OOVLXBF7ZYWV5LRYSGMVXA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949472498 (593h2m18.832886128s) [noise=true , address=77.90.31.18:4817 , piece_id=7FZU2HQAWBWMSZ2ZHKLPJRPUKQHNSIXF3O2DXNIC5E3BNKZQ7MMA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949792417 (593h2m18.833206048s) [noise=true , address=45.91.95.2:4027 , piece_id=O6OHEXXYEZVJYIQSQRAJ4P225SMCRRERKFZD5SPPSJRLSSH7UFMA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:19.506882340 (593h2m19.390295955s) [upload=474167]: Next returned nil segment Jul 18 02:13:19.506923123 (593h2m19.390336751s) [upload=474167]: Waiting for error group managing segments... Jul 18 02:13:19.666828456 (593h2m19.550242074s) [noise=true , address=45.91.116.5:4315 , piece_id=7B4KSGICA5N2MM2TO52UHHKYUOXS2AQHYORMC2TC6RCYAODHV4HQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.669997440 (593h2m19.55341106s) [noise=true , address=45.91.116.8:4075 , piece_id=R63TYEY34PGAQB3QZ3EKCVBZJ6PY3XRZ7FZMPADWGLAWSRR3BV7A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.678533346 (593h2m19.561946983s) [noise=true , address=45.91.116.7:4013 , piece_id=IOSFQDAAUSXBLF7KJFK36SAPUFTIOUOGD65K3KNRUCKMG2NV5M6A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.688823710 (593h2m19.57223733s) [noise=true , address=79.127.219.51:4197 , piece_id=C5PCVWGRXFLMSKY3JIQ34XAWC5CY4JR3XPPSGQ5POIFTA2AVM52Q, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.688899040 (593h2m19.572312661s) [noise=true , address=45.91.116.12:4236 , piece_id=LC7EETGY3NJHRVPE2TFBJWPGFCAMOFV47R2A3TQEIWJ5N6V4264A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.692235863 (593h2m19.575649484s) [noise=true , address=45.91.116.11:4122 , piece_id=2N2PKPMW7MMQKEGBJ5JALY6GA6PQ7H2Z2RV6BRSOTOLLDWGGWEWA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.696462183 (593h2m19.579875811s) [noise=true , address=104.36.82.40:4965 , piece_id=QVBRNABGNUDALSD6YSERJIGPRAVMRCBNZWD6S3L7UE7UMDINXIZQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.813900946 (593h2m19.697314563s) [noise=true , address=45.91.95.4:4023 , piece_id=MHI6MJN3IONG7D6VL5JDWW7J7TZQ5P55TXV6RX6MZZ7M5DYWEOTQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.821077860 (593h2m19.70449148s) [noise=true , address=45.91.95.2:4027 , piece_id=O6OHEXXYEZVJYIQSQRAJ4P225SMCRRERKFZD5SPPSJRLSSH7UFMA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.204635402 (593h2m20.088049022s) [noise=true , address=64.49.13.140:4514 , piece_id=AHOWVODFU6B3AAANVVFU4QZDTRXYMEXWAPHMIUBL445N4QBNBDPA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.284751010 (593h2m20.168164626s) [noise=true , address=79.127.205.233:4655 , piece_id=K7FWZFKAEWHXTY5QOHMRUNIS4VBHG6OOVLXBF7ZYWV5LRYSGMVXA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.285897562 (593h2m20.169311174s) [noise=true , address=79.127.205.234:4617 , piece_id=OXKUU4PF5ZSYD2LTNHJ367GJXCQXDRNGUY2RH3UI7ANAZKNGHE3Q, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:22.157138533 (593h2m22.040552152s) [noise=true , address=104.36.82.5:4866 , piece_id=DN7REXMIHHAYHR3YV4YZ7RIPVWMR42AX6HL46XILWSWHQTXDN2WA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:14:18.469416431 (593h3m18.352830058s) [noise=true , address=77.90.31.15:4707 , piece_id=HEGKDFTKYYIKXRMDOKXOJRTSMAUUBL2D7UBCINKSKQV5KNNRNW3A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL, address:77.90.31.15:4707): protocol: rpc: dial tcp 77.90.31.15:4707: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469487502 (593h3m18.352901118s) [noise=true , address=77.90.31.10:4546 , piece_id=2VKHQSWRL5HYCWMY6463GSMQDOV3GF2GQQF5DKWTA3QSVKG3G2QQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1jjRZPZ6TDPepFAmvv81dREkDJDrXqeu9wqzNYkeaGemFFdxwK, address:77.90.31.10:4546): protocol: write tcp 139.59.144.22:58640->77.90.31.10:4546: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469495352 (593h3m18.352908971s) [noise=true , address=77.90.31.18:4817 , piece_id=7FZU2HQAWBWMSZ2ZHKLPJRPUKQHNSIXF3O2DXNIC5E3BNKZQ7MMA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:12Qv5LBuANP9vS2vbsVNrJ7Mkc3SqXwTNCBzLvN955RHFKQVv5x, address:77.90.31.18:4817): protocol: rpc: dial tcp 77.90.31.18:4817: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469551424 (593h3m18.35296505s) [noise=true , address=77.90.31.13:4645 , piece_id=6AGW7BEMYHIL7BOAUETZWEHJM36HUBJ2HYPNXYPG3FHC2KJYKS2A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg, address:77.90.31.13:4645): protocol: write tcp 139.59.144.22:33516->77.90.31.13:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469590566 (593h3m18.353004192s) [noise=true , address=77.90.31.11:4575 , piece_id=3YZHHBMW2TUSEH5GX7BQF65PXL7ZVUA646JRNBFF3NTCS7BCEQPA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc, address:77.90.31.11:4575): protocol: write tcp 139.59.144.22:46706->77.90.31.11:4575: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Jul 18 02:14:18.469617916 (593h3m18.353031533s) [seg_pos={0 0}, upload=474167]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 02:14:18.582376941 (593h3m18.46579056s) [upload=474167]: Done uploading segments... Jul 18 02:14:18.582410612 (593h3m18.465824233s) [upload=474167]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.481686153s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 2.819581133s FAIL (2025-07-18 02:59:03 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 0468 (593h2m18.628194085s) [upload=474167]: Got next segment. Inline: false Jul 18 02:13:18.744827419 (593h2m18.628241045s) [upload=474167]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 02:13:18.744833270 (593h2m18.628246896s) [upload=474167]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 02:13:18.944247732 (593h2m18.827661359s) [seg_pos={0 0}, upload=474167]: Begin upload segment... Jul 18 02:13:18.944300780 (593h2m18.827714397s) [seg_pos={0 0}, upload=474167]: Done begin upload segment. Jul 18 02:13:18.944327501 (593h2m18.827741131s) [noise=true , address=64.49.13.140:4514 , piece_id=AHOWVODFU6B3AAANVVFU4QZDTRXYMEXWAPHMIUBL445N4QBNBDPA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.944748561 (593h2m18.82816219s) [noise=true , address=104.36.82.40:4965 , piece_id=QVBRNABGNUDALSD6YSERJIGPRAVMRCBNZWD6S3L7UE7UMDINXIZQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945029770 (593h2m18.828443399s) [noise=true , address=104.36.82.5:4866 , piece_id=DN7REXMIHHAYHR3YV4YZ7RIPVWMR42AX6HL46XILWSWHQTXDN2WA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945305573 (593h2m18.828719199s) [noise=true , address=77.90.31.15:4707 , piece_id=HEGKDFTKYYIKXRMDOKXOJRTSMAUUBL2D7UBCINKSKQV5KNNRNW3A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945587945 (593h2m18.829001572s) [noise=true , address=79.127.219.51:4197 , piece_id=C5PCVWGRXFLMSKY3JIQ34XAWC5CY4JR3XPPSGQ5POIFTA2AVM52Q, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945905736 (593h2m18.829319373s) [noise=true , address=45.91.116.11:4122 , piece_id=2N2PKPMW7MMQKEGBJ5JALY6GA6PQ7H2Z2RV6BRSOTOLLDWGGWEWA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946318615 (593h2m18.829732242s) [noise=true , address=45.91.95.4:4023 , piece_id=MHI6MJN3IONG7D6VL5JDWW7J7TZQ5P55TXV6RX6MZZ7M5DYWEOTQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946635972 (593h2m18.830049598s) [noise=true , address=79.127.205.234:4617 , piece_id=OXKUU4PF5ZSYD2LTNHJ367GJXCQXDRNGUY2RH3UI7ANAZKNGHE3Q, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946932847 (593h2m18.830346512s) [noise=true , address=77.90.31.10:4546 , piece_id=2VKHQSWRL5HYCWMY6463GSMQDOV3GF2GQQF5DKWTA3QSVKG3G2QQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947207379 (593h2m18.830621008s) [noise=true , address=77.90.31.11:4575 , piece_id=3YZHHBMW2TUSEH5GX7BQF65PXL7ZVUA646JRNBFF3NTCS7BCEQPA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947511937 (593h2m18.830925567s) [noise=true , address=45.91.116.8:4075 , piece_id=R63TYEY34PGAQB3QZ3EKCVBZJ6PY3XRZ7FZMPADWGLAWSRR3BV7A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947896979 (593h2m18.831310619s) [noise=true , address=45.91.116.7:4013 , piece_id=IOSFQDAAUSXBLF7KJFK36SAPUFTIOUOGD65K3KNRUCKMG2NV5M6A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948220274 (593h2m18.831633901s) [noise=true , address=45.91.116.12:4236 , piece_id=LC7EETGY3NJHRVPE2TFBJWPGFCAMOFV47R2A3TQEIWJ5N6V4264A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948536793 (593h2m18.831950434s) [noise=true , address=77.90.31.13:4645 , piece_id=6AGW7BEMYHIL7BOAUETZWEHJM36HUBJ2HYPNXYPG3FHC2KJYKS2A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948900904 (593h2m18.832314537s) [noise=true , address=45.91.116.5:4315 , piece_id=7B4KSGICA5N2MM2TO52UHHKYUOXS2AQHYORMC2TC6RCYAODHV4HQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949201483 (593h2m18.832615112s) [noise=true , address=79.127.205.233:4655 , piece_id=K7FWZFKAEWHXTY5QOHMRUNIS4VBHG6OOVLXBF7ZYWV5LRYSGMVXA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949472498 (593h2m18.832886128s) [noise=true , address=77.90.31.18:4817 , piece_id=7FZU2HQAWBWMSZ2ZHKLPJRPUKQHNSIXF3O2DXNIC5E3BNKZQ7MMA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949792417 (593h2m18.833206048s) [noise=true , address=45.91.95.2:4027 , piece_id=O6OHEXXYEZVJYIQSQRAJ4P225SMCRRERKFZD5SPPSJRLSSH7UFMA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:19.506882340 (593h2m19.390295955s) [upload=474167]: Next returned nil segment Jul 18 02:13:19.506923123 (593h2m19.390336751s) [upload=474167]: Waiting for error group managing segments... Jul 18 02:13:19.666828456 (593h2m19.550242074s) [noise=true , address=45.91.116.5:4315 , piece_id=7B4KSGICA5N2MM2TO52UHHKYUOXS2AQHYORMC2TC6RCYAODHV4HQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.669997440 (593h2m19.55341106s) [noise=true , address=45.91.116.8:4075 , piece_id=R63TYEY34PGAQB3QZ3EKCVBZJ6PY3XRZ7FZMPADWGLAWSRR3BV7A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.678533346 (593h2m19.561946983s) [noise=true , address=45.91.116.7:4013 , piece_id=IOSFQDAAUSXBLF7KJFK36SAPUFTIOUOGD65K3KNRUCKMG2NV5M6A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.688823710 (593h2m19.57223733s) [noise=true , address=79.127.219.51:4197 , piece_id=C5PCVWGRXFLMSKY3JIQ34XAWC5CY4JR3XPPSGQ5POIFTA2AVM52Q, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.688899040 (593h2m19.572312661s) [noise=true , address=45.91.116.12:4236 , piece_id=LC7EETGY3NJHRVPE2TFBJWPGFCAMOFV47R2A3TQEIWJ5N6V4264A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.692235863 (593h2m19.575649484s) [noise=true , address=45.91.116.11:4122 , piece_id=2N2PKPMW7MMQKEGBJ5JALY6GA6PQ7H2Z2RV6BRSOTOLLDWGGWEWA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.696462183 (593h2m19.579875811s) [noise=true , address=104.36.82.40:4965 , piece_id=QVBRNABGNUDALSD6YSERJIGPRAVMRCBNZWD6S3L7UE7UMDINXIZQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.813900946 (593h2m19.697314563s) [noise=true , address=45.91.95.4:4023 , piece_id=MHI6MJN3IONG7D6VL5JDWW7J7TZQ5P55TXV6RX6MZZ7M5DYWEOTQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.821077860 (593h2m19.70449148s) [noise=true , address=45.91.95.2:4027 , piece_id=O6OHEXXYEZVJYIQSQRAJ4P225SMCRRERKFZD5SPPSJRLSSH7UFMA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.204635402 (593h2m20.088049022s) [noise=true , address=64.49.13.140:4514 , piece_id=AHOWVODFU6B3AAANVVFU4QZDTRXYMEXWAPHMIUBL445N4QBNBDPA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.284751010 (593h2m20.168164626s) [noise=true , address=79.127.205.233:4655 , piece_id=K7FWZFKAEWHXTY5QOHMRUNIS4VBHG6OOVLXBF7ZYWV5LRYSGMVXA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.285897562 (593h2m20.169311174s) [noise=true , address=79.127.205.234:4617 , piece_id=OXKUU4PF5ZSYD2LTNHJ367GJXCQXDRNGUY2RH3UI7ANAZKNGHE3Q, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:22.157138533 (593h2m22.040552152s) [noise=true , address=104.36.82.5:4866 , piece_id=DN7REXMIHHAYHR3YV4YZ7RIPVWMR42AX6HL46XILWSWHQTXDN2WA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:14:18.469416431 (593h3m18.352830058s) [noise=true , address=77.90.31.15:4707 , piece_id=HEGKDFTKYYIKXRMDOKXOJRTSMAUUBL2D7UBCINKSKQV5KNNRNW3A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL, address:77.90.31.15:4707): protocol: rpc: dial tcp 77.90.31.15:4707: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469487502 (593h3m18.352901118s) [noise=true , address=77.90.31.10:4546 , piece_id=2VKHQSWRL5HYCWMY6463GSMQDOV3GF2GQQF5DKWTA3QSVKG3G2QQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1jjRZPZ6TDPepFAmvv81dREkDJDrXqeu9wqzNYkeaGemFFdxwK, address:77.90.31.10:4546): protocol: write tcp 139.59.144.22:58640->77.90.31.10:4546: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469495352 (593h3m18.352908971s) [noise=true , address=77.90.31.18:4817 , piece_id=7FZU2HQAWBWMSZ2ZHKLPJRPUKQHNSIXF3O2DXNIC5E3BNKZQ7MMA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:12Qv5LBuANP9vS2vbsVNrJ7Mkc3SqXwTNCBzLvN955RHFKQVv5x, address:77.90.31.18:4817): protocol: rpc: dial tcp 77.90.31.18:4817: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469551424 (593h3m18.35296505s) [noise=true , address=77.90.31.13:4645 , piece_id=6AGW7BEMYHIL7BOAUETZWEHJM36HUBJ2HYPNXYPG3FHC2KJYKS2A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg, address:77.90.31.13:4645): protocol: write tcp 139.59.144.22:33516->77.90.31.13:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469590566 (593h3m18.353004192s) [noise=true , address=77.90.31.11:4575 , piece_id=3YZHHBMW2TUSEH5GX7BQF65PXL7ZVUA646JRNBFF3NTCS7BCEQPA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc, address:77.90.31.11:4575): protocol: write tcp 139.59.144.22:46706->77.90.31.11:4575: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Jul 18 02:14:18.469617916 (593h3m18.353031533s) [seg_pos={0 0}, upload=474167]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 02:14:18.582376941 (593h3m18.46579056s) [upload=474167]: Done uploading segments... Jul 18 02:14:18.582410612 (593h3m18.465824233s) [upload=474167]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.819609135s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...XX.......................................................] duration: 2.501093221s FAIL (2025-07-18 02:57:57 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 0468 (593h2m18.628194085s) [upload=474167]: Got next segment. Inline: false Jul 18 02:13:18.744827419 (593h2m18.628241045s) [upload=474167]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 02:13:18.744833270 (593h2m18.628246896s) [upload=474167]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 02:13:18.944247732 (593h2m18.827661359s) [seg_pos={0 0}, upload=474167]: Begin upload segment... Jul 18 02:13:18.944300780 (593h2m18.827714397s) [seg_pos={0 0}, upload=474167]: Done begin upload segment. Jul 18 02:13:18.944327501 (593h2m18.827741131s) [noise=true , address=64.49.13.140:4514 , piece_id=AHOWVODFU6B3AAANVVFU4QZDTRXYMEXWAPHMIUBL445N4QBNBDPA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.944748561 (593h2m18.82816219s) [noise=true , address=104.36.82.40:4965 , piece_id=QVBRNABGNUDALSD6YSERJIGPRAVMRCBNZWD6S3L7UE7UMDINXIZQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945029770 (593h2m18.828443399s) [noise=true , address=104.36.82.5:4866 , piece_id=DN7REXMIHHAYHR3YV4YZ7RIPVWMR42AX6HL46XILWSWHQTXDN2WA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945305573 (593h2m18.828719199s) [noise=true , address=77.90.31.15:4707 , piece_id=HEGKDFTKYYIKXRMDOKXOJRTSMAUUBL2D7UBCINKSKQV5KNNRNW3A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945587945 (593h2m18.829001572s) [noise=true , address=79.127.219.51:4197 , piece_id=C5PCVWGRXFLMSKY3JIQ34XAWC5CY4JR3XPPSGQ5POIFTA2AVM52Q, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945905736 (593h2m18.829319373s) [noise=true , address=45.91.116.11:4122 , piece_id=2N2PKPMW7MMQKEGBJ5JALY6GA6PQ7H2Z2RV6BRSOTOLLDWGGWEWA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946318615 (593h2m18.829732242s) [noise=true , address=45.91.95.4:4023 , piece_id=MHI6MJN3IONG7D6VL5JDWW7J7TZQ5P55TXV6RX6MZZ7M5DYWEOTQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946635972 (593h2m18.830049598s) [noise=true , address=79.127.205.234:4617 , piece_id=OXKUU4PF5ZSYD2LTNHJ367GJXCQXDRNGUY2RH3UI7ANAZKNGHE3Q, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946932847 (593h2m18.830346512s) [noise=true , address=77.90.31.10:4546 , piece_id=2VKHQSWRL5HYCWMY6463GSMQDOV3GF2GQQF5DKWTA3QSVKG3G2QQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947207379 (593h2m18.830621008s) [noise=true , address=77.90.31.11:4575 , piece_id=3YZHHBMW2TUSEH5GX7BQF65PXL7ZVUA646JRNBFF3NTCS7BCEQPA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947511937 (593h2m18.830925567s) [noise=true , address=45.91.116.8:4075 , piece_id=R63TYEY34PGAQB3QZ3EKCVBZJ6PY3XRZ7FZMPADWGLAWSRR3BV7A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947896979 (593h2m18.831310619s) [noise=true , address=45.91.116.7:4013 , piece_id=IOSFQDAAUSXBLF7KJFK36SAPUFTIOUOGD65K3KNRUCKMG2NV5M6A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948220274 (593h2m18.831633901s) [noise=true , address=45.91.116.12:4236 , piece_id=LC7EETGY3NJHRVPE2TFBJWPGFCAMOFV47R2A3TQEIWJ5N6V4264A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948536793 (593h2m18.831950434s) [noise=true , address=77.90.31.13:4645 , piece_id=6AGW7BEMYHIL7BOAUETZWEHJM36HUBJ2HYPNXYPG3FHC2KJYKS2A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948900904 (593h2m18.832314537s) [noise=true , address=45.91.116.5:4315 , piece_id=7B4KSGICA5N2MM2TO52UHHKYUOXS2AQHYORMC2TC6RCYAODHV4HQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949201483 (593h2m18.832615112s) [noise=true , address=79.127.205.233:4655 , piece_id=K7FWZFKAEWHXTY5QOHMRUNIS4VBHG6OOVLXBF7ZYWV5LRYSGMVXA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949472498 (593h2m18.832886128s) [noise=true , address=77.90.31.18:4817 , piece_id=7FZU2HQAWBWMSZ2ZHKLPJRPUKQHNSIXF3O2DXNIC5E3BNKZQ7MMA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949792417 (593h2m18.833206048s) [noise=true , address=45.91.95.2:4027 , piece_id=O6OHEXXYEZVJYIQSQRAJ4P225SMCRRERKFZD5SPPSJRLSSH7UFMA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:19.506882340 (593h2m19.390295955s) [upload=474167]: Next returned nil segment Jul 18 02:13:19.506923123 (593h2m19.390336751s) [upload=474167]: Waiting for error group managing segments... Jul 18 02:13:19.666828456 (593h2m19.550242074s) [noise=true , address=45.91.116.5:4315 , piece_id=7B4KSGICA5N2MM2TO52UHHKYUOXS2AQHYORMC2TC6RCYAODHV4HQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.669997440 (593h2m19.55341106s) [noise=true , address=45.91.116.8:4075 , piece_id=R63TYEY34PGAQB3QZ3EKCVBZJ6PY3XRZ7FZMPADWGLAWSRR3BV7A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.678533346 (593h2m19.561946983s) [noise=true , address=45.91.116.7:4013 , piece_id=IOSFQDAAUSXBLF7KJFK36SAPUFTIOUOGD65K3KNRUCKMG2NV5M6A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.688823710 (593h2m19.57223733s) [noise=true , address=79.127.219.51:4197 , piece_id=C5PCVWGRXFLMSKY3JIQ34XAWC5CY4JR3XPPSGQ5POIFTA2AVM52Q, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.688899040 (593h2m19.572312661s) [noise=true , address=45.91.116.12:4236 , piece_id=LC7EETGY3NJHRVPE2TFBJWPGFCAMOFV47R2A3TQEIWJ5N6V4264A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.692235863 (593h2m19.575649484s) [noise=true , address=45.91.116.11:4122 , piece_id=2N2PKPMW7MMQKEGBJ5JALY6GA6PQ7H2Z2RV6BRSOTOLLDWGGWEWA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.696462183 (593h2m19.579875811s) [noise=true , address=104.36.82.40:4965 , piece_id=QVBRNABGNUDALSD6YSERJIGPRAVMRCBNZWD6S3L7UE7UMDINXIZQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.813900946 (593h2m19.697314563s) [noise=true , address=45.91.95.4:4023 , piece_id=MHI6MJN3IONG7D6VL5JDWW7J7TZQ5P55TXV6RX6MZZ7M5DYWEOTQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.821077860 (593h2m19.70449148s) [noise=true , address=45.91.95.2:4027 , piece_id=O6OHEXXYEZVJYIQSQRAJ4P225SMCRRERKFZD5SPPSJRLSSH7UFMA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.204635402 (593h2m20.088049022s) [noise=true , address=64.49.13.140:4514 , piece_id=AHOWVODFU6B3AAANVVFU4QZDTRXYMEXWAPHMIUBL445N4QBNBDPA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.284751010 (593h2m20.168164626s) [noise=true , address=79.127.205.233:4655 , piece_id=K7FWZFKAEWHXTY5QOHMRUNIS4VBHG6OOVLXBF7ZYWV5LRYSGMVXA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.285897562 (593h2m20.169311174s) [noise=true , address=79.127.205.234:4617 , piece_id=OXKUU4PF5ZSYD2LTNHJ367GJXCQXDRNGUY2RH3UI7ANAZKNGHE3Q, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:22.157138533 (593h2m22.040552152s) [noise=true , address=104.36.82.5:4866 , piece_id=DN7REXMIHHAYHR3YV4YZ7RIPVWMR42AX6HL46XILWSWHQTXDN2WA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:14:18.469416431 (593h3m18.352830058s) [noise=true , address=77.90.31.15:4707 , piece_id=HEGKDFTKYYIKXRMDOKXOJRTSMAUUBL2D7UBCINKSKQV5KNNRNW3A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL, address:77.90.31.15:4707): protocol: rpc: dial tcp 77.90.31.15:4707: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469487502 (593h3m18.352901118s) [noise=true , address=77.90.31.10:4546 , piece_id=2VKHQSWRL5HYCWMY6463GSMQDOV3GF2GQQF5DKWTA3QSVKG3G2QQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1jjRZPZ6TDPepFAmvv81dREkDJDrXqeu9wqzNYkeaGemFFdxwK, address:77.90.31.10:4546): protocol: write tcp 139.59.144.22:58640->77.90.31.10:4546: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469495352 (593h3m18.352908971s) [noise=true , address=77.90.31.18:4817 , piece_id=7FZU2HQAWBWMSZ2ZHKLPJRPUKQHNSIXF3O2DXNIC5E3BNKZQ7MMA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:12Qv5LBuANP9vS2vbsVNrJ7Mkc3SqXwTNCBzLvN955RHFKQVv5x, address:77.90.31.18:4817): protocol: rpc: dial tcp 77.90.31.18:4817: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469551424 (593h3m18.35296505s) [noise=true , address=77.90.31.13:4645 , piece_id=6AGW7BEMYHIL7BOAUETZWEHJM36HUBJ2HYPNXYPG3FHC2KJYKS2A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg, address:77.90.31.13:4645): protocol: write tcp 139.59.144.22:33516->77.90.31.13:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469590566 (593h3m18.353004192s) [noise=true , address=77.90.31.11:4575 , piece_id=3YZHHBMW2TUSEH5GX7BQF65PXL7ZVUA646JRNBFF3NTCS7BCEQPA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc, address:77.90.31.11:4575): protocol: write tcp 139.59.144.22:46706->77.90.31.11:4575: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Jul 18 02:14:18.469617916 (593h3m18.353031533s) [seg_pos={0 0}, upload=474167]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 02:14:18.582376941 (593h3m18.46579056s) [upload=474167]: Done uploading segments... Jul 18 02:14:18.582410612 (593h3m18.465824233s) [upload=474167]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.501128189s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....XX......................................................] duration: 2.819821295s FAIL (2025-07-18 02:57:03 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 0468 (593h2m18.628194085s) [upload=474167]: Got next segment. Inline: false Jul 18 02:13:18.744827419 (593h2m18.628241045s) [upload=474167]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 02:13:18.744833270 (593h2m18.628246896s) [upload=474167]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 02:13:18.944247732 (593h2m18.827661359s) [seg_pos={0 0}, upload=474167]: Begin upload segment... Jul 18 02:13:18.944300780 (593h2m18.827714397s) [seg_pos={0 0}, upload=474167]: Done begin upload segment. Jul 18 02:13:18.944327501 (593h2m18.827741131s) [noise=true , address=64.49.13.140:4514 , piece_id=AHOWVODFU6B3AAANVVFU4QZDTRXYMEXWAPHMIUBL445N4QBNBDPA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.944748561 (593h2m18.82816219s) [noise=true , address=104.36.82.40:4965 , piece_id=QVBRNABGNUDALSD6YSERJIGPRAVMRCBNZWD6S3L7UE7UMDINXIZQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945029770 (593h2m18.828443399s) [noise=true , address=104.36.82.5:4866 , piece_id=DN7REXMIHHAYHR3YV4YZ7RIPVWMR42AX6HL46XILWSWHQTXDN2WA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945305573 (593h2m18.828719199s) [noise=true , address=77.90.31.15:4707 , piece_id=HEGKDFTKYYIKXRMDOKXOJRTSMAUUBL2D7UBCINKSKQV5KNNRNW3A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945587945 (593h2m18.829001572s) [noise=true , address=79.127.219.51:4197 , piece_id=C5PCVWGRXFLMSKY3JIQ34XAWC5CY4JR3XPPSGQ5POIFTA2AVM52Q, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945905736 (593h2m18.829319373s) [noise=true , address=45.91.116.11:4122 , piece_id=2N2PKPMW7MMQKEGBJ5JALY6GA6PQ7H2Z2RV6BRSOTOLLDWGGWEWA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946318615 (593h2m18.829732242s) [noise=true , address=45.91.95.4:4023 , piece_id=MHI6MJN3IONG7D6VL5JDWW7J7TZQ5P55TXV6RX6MZZ7M5DYWEOTQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946635972 (593h2m18.830049598s) [noise=true , address=79.127.205.234:4617 , piece_id=OXKUU4PF5ZSYD2LTNHJ367GJXCQXDRNGUY2RH3UI7ANAZKNGHE3Q, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946932847 (593h2m18.830346512s) [noise=true , address=77.90.31.10:4546 , piece_id=2VKHQSWRL5HYCWMY6463GSMQDOV3GF2GQQF5DKWTA3QSVKG3G2QQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947207379 (593h2m18.830621008s) [noise=true , address=77.90.31.11:4575 , piece_id=3YZHHBMW2TUSEH5GX7BQF65PXL7ZVUA646JRNBFF3NTCS7BCEQPA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947511937 (593h2m18.830925567s) [noise=true , address=45.91.116.8:4075 , piece_id=R63TYEY34PGAQB3QZ3EKCVBZJ6PY3XRZ7FZMPADWGLAWSRR3BV7A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947896979 (593h2m18.831310619s) [noise=true , address=45.91.116.7:4013 , piece_id=IOSFQDAAUSXBLF7KJFK36SAPUFTIOUOGD65K3KNRUCKMG2NV5M6A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948220274 (593h2m18.831633901s) [noise=true , address=45.91.116.12:4236 , piece_id=LC7EETGY3NJHRVPE2TFBJWPGFCAMOFV47R2A3TQEIWJ5N6V4264A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948536793 (593h2m18.831950434s) [noise=true , address=77.90.31.13:4645 , piece_id=6AGW7BEMYHIL7BOAUETZWEHJM36HUBJ2HYPNXYPG3FHC2KJYKS2A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948900904 (593h2m18.832314537s) [noise=true , address=45.91.116.5:4315 , piece_id=7B4KSGICA5N2MM2TO52UHHKYUOXS2AQHYORMC2TC6RCYAODHV4HQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949201483 (593h2m18.832615112s) [noise=true , address=79.127.205.233:4655 , piece_id=K7FWZFKAEWHXTY5QOHMRUNIS4VBHG6OOVLXBF7ZYWV5LRYSGMVXA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949472498 (593h2m18.832886128s) [noise=true , address=77.90.31.18:4817 , piece_id=7FZU2HQAWBWMSZ2ZHKLPJRPUKQHNSIXF3O2DXNIC5E3BNKZQ7MMA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949792417 (593h2m18.833206048s) [noise=true , address=45.91.95.2:4027 , piece_id=O6OHEXXYEZVJYIQSQRAJ4P225SMCRRERKFZD5SPPSJRLSSH7UFMA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:19.506882340 (593h2m19.390295955s) [upload=474167]: Next returned nil segment Jul 18 02:13:19.506923123 (593h2m19.390336751s) [upload=474167]: Waiting for error group managing segments... Jul 18 02:13:19.666828456 (593h2m19.550242074s) [noise=true , address=45.91.116.5:4315 , piece_id=7B4KSGICA5N2MM2TO52UHHKYUOXS2AQHYORMC2TC6RCYAODHV4HQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.669997440 (593h2m19.55341106s) [noise=true , address=45.91.116.8:4075 , piece_id=R63TYEY34PGAQB3QZ3EKCVBZJ6PY3XRZ7FZMPADWGLAWSRR3BV7A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.678533346 (593h2m19.561946983s) [noise=true , address=45.91.116.7:4013 , piece_id=IOSFQDAAUSXBLF7KJFK36SAPUFTIOUOGD65K3KNRUCKMG2NV5M6A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.688823710 (593h2m19.57223733s) [noise=true , address=79.127.219.51:4197 , piece_id=C5PCVWGRXFLMSKY3JIQ34XAWC5CY4JR3XPPSGQ5POIFTA2AVM52Q, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.688899040 (593h2m19.572312661s) [noise=true , address=45.91.116.12:4236 , piece_id=LC7EETGY3NJHRVPE2TFBJWPGFCAMOFV47R2A3TQEIWJ5N6V4264A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.692235863 (593h2m19.575649484s) [noise=true , address=45.91.116.11:4122 , piece_id=2N2PKPMW7MMQKEGBJ5JALY6GA6PQ7H2Z2RV6BRSOTOLLDWGGWEWA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.696462183 (593h2m19.579875811s) [noise=true , address=104.36.82.40:4965 , piece_id=QVBRNABGNUDALSD6YSERJIGPRAVMRCBNZWD6S3L7UE7UMDINXIZQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.813900946 (593h2m19.697314563s) [noise=true , address=45.91.95.4:4023 , piece_id=MHI6MJN3IONG7D6VL5JDWW7J7TZQ5P55TXV6RX6MZZ7M5DYWEOTQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.821077860 (593h2m19.70449148s) [noise=true , address=45.91.95.2:4027 , piece_id=O6OHEXXYEZVJYIQSQRAJ4P225SMCRRERKFZD5SPPSJRLSSH7UFMA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.204635402 (593h2m20.088049022s) [noise=true , address=64.49.13.140:4514 , piece_id=AHOWVODFU6B3AAANVVFU4QZDTRXYMEXWAPHMIUBL445N4QBNBDPA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.284751010 (593h2m20.168164626s) [noise=true , address=79.127.205.233:4655 , piece_id=K7FWZFKAEWHXTY5QOHMRUNIS4VBHG6OOVLXBF7ZYWV5LRYSGMVXA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.285897562 (593h2m20.169311174s) [noise=true , address=79.127.205.234:4617 , piece_id=OXKUU4PF5ZSYD2LTNHJ367GJXCQXDRNGUY2RH3UI7ANAZKNGHE3Q, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:22.157138533 (593h2m22.040552152s) [noise=true , address=104.36.82.5:4866 , piece_id=DN7REXMIHHAYHR3YV4YZ7RIPVWMR42AX6HL46XILWSWHQTXDN2WA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:14:18.469416431 (593h3m18.352830058s) [noise=true , address=77.90.31.15:4707 , piece_id=HEGKDFTKYYIKXRMDOKXOJRTSMAUUBL2D7UBCINKSKQV5KNNRNW3A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL, address:77.90.31.15:4707): protocol: rpc: dial tcp 77.90.31.15:4707: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469487502 (593h3m18.352901118s) [noise=true , address=77.90.31.10:4546 , piece_id=2VKHQSWRL5HYCWMY6463GSMQDOV3GF2GQQF5DKWTA3QSVKG3G2QQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1jjRZPZ6TDPepFAmvv81dREkDJDrXqeu9wqzNYkeaGemFFdxwK, address:77.90.31.10:4546): protocol: write tcp 139.59.144.22:58640->77.90.31.10:4546: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469495352 (593h3m18.352908971s) [noise=true , address=77.90.31.18:4817 , piece_id=7FZU2HQAWBWMSZ2ZHKLPJRPUKQHNSIXF3O2DXNIC5E3BNKZQ7MMA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:12Qv5LBuANP9vS2vbsVNrJ7Mkc3SqXwTNCBzLvN955RHFKQVv5x, address:77.90.31.18:4817): protocol: rpc: dial tcp 77.90.31.18:4817: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469551424 (593h3m18.35296505s) [noise=true , address=77.90.31.13:4645 , piece_id=6AGW7BEMYHIL7BOAUETZWEHJM36HUBJ2HYPNXYPG3FHC2KJYKS2A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg, address:77.90.31.13:4645): protocol: write tcp 139.59.144.22:33516->77.90.31.13:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469590566 (593h3m18.353004192s) [noise=true , address=77.90.31.11:4575 , piece_id=3YZHHBMW2TUSEH5GX7BQF65PXL7ZVUA646JRNBFF3NTCS7BCEQPA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc, address:77.90.31.11:4575): protocol: write tcp 139.59.144.22:46706->77.90.31.11:4575: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Jul 18 02:14:18.469617916 (593h3m18.353031533s) [seg_pos={0 0}, upload=474167]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 02:14:18.582376941 (593h3m18.46579056s) [upload=474167]: Done uploading segments... Jul 18 02:14:18.582410612 (593h3m18.465824233s) [upload=474167]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.819872951s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration: 2.575933837s FAIL (2025-07-18 02:55:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 0468 (593h2m18.628194085s) [upload=474167]: Got next segment. Inline: false Jul 18 02:13:18.744827419 (593h2m18.628241045s) [upload=474167]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 02:13:18.744833270 (593h2m18.628246896s) [upload=474167]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 02:13:18.944247732 (593h2m18.827661359s) [seg_pos={0 0}, upload=474167]: Begin upload segment... Jul 18 02:13:18.944300780 (593h2m18.827714397s) [seg_pos={0 0}, upload=474167]: Done begin upload segment. Jul 18 02:13:18.944327501 (593h2m18.827741131s) [noise=true , address=64.49.13.140:4514 , piece_id=AHOWVODFU6B3AAANVVFU4QZDTRXYMEXWAPHMIUBL445N4QBNBDPA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.944748561 (593h2m18.82816219s) [noise=true , address=104.36.82.40:4965 , piece_id=QVBRNABGNUDALSD6YSERJIGPRAVMRCBNZWD6S3L7UE7UMDINXIZQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945029770 (593h2m18.828443399s) [noise=true , address=104.36.82.5:4866 , piece_id=DN7REXMIHHAYHR3YV4YZ7RIPVWMR42AX6HL46XILWSWHQTXDN2WA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945305573 (593h2m18.828719199s) [noise=true , address=77.90.31.15:4707 , piece_id=HEGKDFTKYYIKXRMDOKXOJRTSMAUUBL2D7UBCINKSKQV5KNNRNW3A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945587945 (593h2m18.829001572s) [noise=true , address=79.127.219.51:4197 , piece_id=C5PCVWGRXFLMSKY3JIQ34XAWC5CY4JR3XPPSGQ5POIFTA2AVM52Q, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.945905736 (593h2m18.829319373s) [noise=true , address=45.91.116.11:4122 , piece_id=2N2PKPMW7MMQKEGBJ5JALY6GA6PQ7H2Z2RV6BRSOTOLLDWGGWEWA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946318615 (593h2m18.829732242s) [noise=true , address=45.91.95.4:4023 , piece_id=MHI6MJN3IONG7D6VL5JDWW7J7TZQ5P55TXV6RX6MZZ7M5DYWEOTQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946635972 (593h2m18.830049598s) [noise=true , address=79.127.205.234:4617 , piece_id=OXKUU4PF5ZSYD2LTNHJ367GJXCQXDRNGUY2RH3UI7ANAZKNGHE3Q, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.946932847 (593h2m18.830346512s) [noise=true , address=77.90.31.10:4546 , piece_id=2VKHQSWRL5HYCWMY6463GSMQDOV3GF2GQQF5DKWTA3QSVKG3G2QQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947207379 (593h2m18.830621008s) [noise=true , address=77.90.31.11:4575 , piece_id=3YZHHBMW2TUSEH5GX7BQF65PXL7ZVUA646JRNBFF3NTCS7BCEQPA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947511937 (593h2m18.830925567s) [noise=true , address=45.91.116.8:4075 , piece_id=R63TYEY34PGAQB3QZ3EKCVBZJ6PY3XRZ7FZMPADWGLAWSRR3BV7A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.947896979 (593h2m18.831310619s) [noise=true , address=45.91.116.7:4013 , piece_id=IOSFQDAAUSXBLF7KJFK36SAPUFTIOUOGD65K3KNRUCKMG2NV5M6A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948220274 (593h2m18.831633901s) [noise=true , address=45.91.116.12:4236 , piece_id=LC7EETGY3NJHRVPE2TFBJWPGFCAMOFV47R2A3TQEIWJ5N6V4264A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948536793 (593h2m18.831950434s) [noise=true , address=77.90.31.13:4645 , piece_id=6AGW7BEMYHIL7BOAUETZWEHJM36HUBJ2HYPNXYPG3FHC2KJYKS2A, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.948900904 (593h2m18.832314537s) [noise=true , address=45.91.116.5:4315 , piece_id=7B4KSGICA5N2MM2TO52UHHKYUOXS2AQHYORMC2TC6RCYAODHV4HQ, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949201483 (593h2m18.832615112s) [noise=true , address=79.127.205.233:4655 , piece_id=K7FWZFKAEWHXTY5QOHMRUNIS4VBHG6OOVLXBF7ZYWV5LRYSGMVXA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949472498 (593h2m18.832886128s) [noise=true , address=77.90.31.18:4817 , piece_id=7FZU2HQAWBWMSZ2ZHKLPJRPUKQHNSIXF3O2DXNIC5E3BNKZQ7MMA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:18.949792417 (593h2m18.833206048s) [noise=true , address=45.91.95.2:4027 , piece_id=O6OHEXXYEZVJYIQSQRAJ4P225SMCRRERKFZD5SPPSJRLSSH7UFMA, seg_pos={0 0}, upload=474167]: Uploading piece... Jul 18 02:13:19.506882340 (593h2m19.390295955s) [upload=474167]: Next returned nil segment Jul 18 02:13:19.506923123 (593h2m19.390336751s) [upload=474167]: Waiting for error group managing segments... Jul 18 02:13:19.666828456 (593h2m19.550242074s) [noise=true , address=45.91.116.5:4315 , piece_id=7B4KSGICA5N2MM2TO52UHHKYUOXS2AQHYORMC2TC6RCYAODHV4HQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.669997440 (593h2m19.55341106s) [noise=true , address=45.91.116.8:4075 , piece_id=R63TYEY34PGAQB3QZ3EKCVBZJ6PY3XRZ7FZMPADWGLAWSRR3BV7A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.678533346 (593h2m19.561946983s) [noise=true , address=45.91.116.7:4013 , piece_id=IOSFQDAAUSXBLF7KJFK36SAPUFTIOUOGD65K3KNRUCKMG2NV5M6A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.688823710 (593h2m19.57223733s) [noise=true , address=79.127.219.51:4197 , piece_id=C5PCVWGRXFLMSKY3JIQ34XAWC5CY4JR3XPPSGQ5POIFTA2AVM52Q, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.688899040 (593h2m19.572312661s) [noise=true , address=45.91.116.12:4236 , piece_id=LC7EETGY3NJHRVPE2TFBJWPGFCAMOFV47R2A3TQEIWJ5N6V4264A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.692235863 (593h2m19.575649484s) [noise=true , address=45.91.116.11:4122 , piece_id=2N2PKPMW7MMQKEGBJ5JALY6GA6PQ7H2Z2RV6BRSOTOLLDWGGWEWA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.696462183 (593h2m19.579875811s) [noise=true , address=104.36.82.40:4965 , piece_id=QVBRNABGNUDALSD6YSERJIGPRAVMRCBNZWD6S3L7UE7UMDINXIZQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.813900946 (593h2m19.697314563s) [noise=true , address=45.91.95.4:4023 , piece_id=MHI6MJN3IONG7D6VL5JDWW7J7TZQ5P55TXV6RX6MZZ7M5DYWEOTQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:19.821077860 (593h2m19.70449148s) [noise=true , address=45.91.95.2:4027 , piece_id=O6OHEXXYEZVJYIQSQRAJ4P225SMCRRERKFZD5SPPSJRLSSH7UFMA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.204635402 (593h2m20.088049022s) [noise=true , address=64.49.13.140:4514 , piece_id=AHOWVODFU6B3AAANVVFU4QZDTRXYMEXWAPHMIUBL445N4QBNBDPA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.284751010 (593h2m20.168164626s) [noise=true , address=79.127.205.233:4655 , piece_id=K7FWZFKAEWHXTY5QOHMRUNIS4VBHG6OOVLXBF7ZYWV5LRYSGMVXA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:20.285897562 (593h2m20.169311174s) [noise=true , address=79.127.205.234:4617 , piece_id=OXKUU4PF5ZSYD2LTNHJ367GJXCQXDRNGUY2RH3UI7ANAZKNGHE3Q, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:13:22.157138533 (593h2m22.040552152s) [noise=true , address=104.36.82.5:4866 , piece_id=DN7REXMIHHAYHR3YV4YZ7RIPVWMR42AX6HL46XILWSWHQTXDN2WA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: <nil> Jul 18 02:14:18.469416431 (593h3m18.352830058s) [noise=true , address=77.90.31.15:4707 , piece_id=HEGKDFTKYYIKXRMDOKXOJRTSMAUUBL2D7UBCINKSKQV5KNNRNW3A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL, address:77.90.31.15:4707): protocol: rpc: dial tcp 77.90.31.15:4707: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469487502 (593h3m18.352901118s) [noise=true , address=77.90.31.10:4546 , piece_id=2VKHQSWRL5HYCWMY6463GSMQDOV3GF2GQQF5DKWTA3QSVKG3G2QQ, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1jjRZPZ6TDPepFAmvv81dREkDJDrXqeu9wqzNYkeaGemFFdxwK, address:77.90.31.10:4546): protocol: write tcp 139.59.144.22:58640->77.90.31.10:4546: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469495352 (593h3m18.352908971s) [noise=true , address=77.90.31.18:4817 , piece_id=7FZU2HQAWBWMSZ2ZHKLPJRPUKQHNSIXF3O2DXNIC5E3BNKZQ7MMA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:12Qv5LBuANP9vS2vbsVNrJ7Mkc3SqXwTNCBzLvN955RHFKQVv5x, address:77.90.31.18:4817): protocol: rpc: dial tcp 77.90.31.18:4817: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469551424 (593h3m18.35296505s) [noise=true , address=77.90.31.13:4645 , piece_id=6AGW7BEMYHIL7BOAUETZWEHJM36HUBJ2HYPNXYPG3FHC2KJYKS2A, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg, address:77.90.31.13:4645): protocol: write tcp 139.59.144.22:33516->77.90.31.13:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 02:14:18.469590566 (593h3m18.353004192s) [noise=true , address=77.90.31.11:4575 , piece_id=3YZHHBMW2TUSEH5GX7BQF65PXL7ZVUA646JRNBFF3NTCS7BCEQPA, seg_pos={0 0}, upload=474167]: Done uploading piece. err: ecclient: upload failed (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc, address:77.90.31.11:4575): protocol: write tcp 139.59.144.22:46706->77.90.31.11:4575: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Jul 18 02:14:18.469617916 (593h3m18.353031533s) [seg_pos={0 0}, upload=474167]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 18 02:14:18.582376941 (593h3m18.46579056s) [upload=474167]: Done uploading segments... Jul 18 02:14:18.582410612 (593h3m18.465824233s) [upload=474167]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.575954351s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)