Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 18 out of 60 is failed (threshold=3) [.........................................XXXXXXXXXXXXX.XXXXX] duration: 1m0.018784047s trace: https://jaeger.dev.storj.io/trace/44efa734d5ae8aa6 FAIL (2026-01-28 12:49:20 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== WX2XZMOYII7QLTYKQ2X4MV5H43X5FPCQ, seg_pos={0 0}, upload=271691]: Uploading piece... Jan 28 12:48:20.494481972 (308h52m58.37843617s) [noise=true , address=89.149.201.147:4010 , piece_id=WI7IK4GDGPWVJOHQ5AJPLJD6654P6KO7ESXVWLASAJQAUJ2DTNCQ, seg_pos={0 0}, upload=271691]: Uploading piece... Jan 28 12:48:20.494936324 (308h52m58.378890524s) [noise=true , address=185.167.204.206:4041 , piece_id=FUNZ35BXXPIUU4YFCVAJ5IVFCYZUR2452DSQMKCXVB2ZZSLRLCIQ, seg_pos={0 0}, upload=271691]: Uploading piece... Jan 28 12:48:20.495550549 (308h52m58.379504752s) [noise=true , address=185.167.204.206:4047 , piece_id=GBYULYNO5A3OF6CERM6UVEKTWAJFLREZSNPPQXJ72V557B7AA6EQ, seg_pos={0 0}, upload=271691]: Uploading piece... Jan 28 12:48:20.496034834 (308h52m58.379989033s) [noise=true , address=185.167.204.205:4013 , piece_id=DJURYWAUHOK5NSWKN5IZQZGAU3HIN3E24U2S5FQVFKSLKPABQ3AQ, seg_pos={0 0}, upload=271691]: Uploading piece... Jan 28 12:48:20.523648447 (308h52m58.407602654s) [noise=true , address=89.149.201.147:4012 , piece_id=DU4MVS5C563FZXKDP5FHRTYDHLMUBOLQBSSQ6EEBFRTXC7E7WDSA, seg_pos={0 0}, upload=271691]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: rpc: dial tcp 89.149.201.147:4012: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:48:20.527747636 (308h52m58.411701839s) [noise=true , address=185.167.204.205:4013 , piece_id=DJURYWAUHOK5NSWKN5IZQZGAU3HIN3E24U2S5FQVFKSLKPABQ3AQ, seg_pos={0 0}, upload=271691]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:54836->185.167.204.205:4013: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:48:20.527991773 (308h52m58.411945975s) [noise=true , address=89.149.201.147:4010 , piece_id=WI7IK4GDGPWVJOHQ5AJPLJD6654P6KO7ESXVWLASAJQAUJ2DTNCQ, seg_pos={0 0}, upload=271691]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:52168->89.149.201.147:4010: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:48:20.530710815 (308h52m58.414665022s) [noise=true , address=89.149.201.147:4005 , piece_id=G744BKC5LK4ZMCGRBCY2KPGF7ZDKS7JZTQ6OZS647G7ESKV23GBQ, seg_pos={0 0}, upload=271691]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:48:20.533852406 (308h52m58.417806608s) [noise=true , address=185.167.204.205:4008 , piece_id=TURK6R52SK3WVVKQCLNXHU2TRR6OWEK5ULXTKI24CGBTOPQ7AHNQ, seg_pos={0 0}, upload=271691]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: write tcp 139.59.144.22:37306->185.167.204.205:4008: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:48:20.537495802 (308h52m58.42145001s) [noise=true , address=89.149.201.147:4011 , piece_id=EYHIQ3Z3KWAEEYMRVLQ3GGNBXIFR355WKETLMXHBBT7HKTAUTEZA, seg_pos={0 0}, upload=271691]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 139.59.144.22:51638->89.149.201.147:4011: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:48:20.551414976 (308h52m58.435369232s) [noise=true , address=185.167.204.205:4002 , piece_id=FKRUKDC47SHNLUKF645JNFXXVWJGS5XAKGFJ3AWXMXHTTYYZT2AQ, seg_pos={0 0}, upload=271691]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 139.59.144.22:36180->185.167.204.205:4002: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:48:20.600678520 (308h52m58.48463272s) [upload=271691]: Next returned nil segment Jan 28 12:48:20.600696581 (308h52m58.484650784s) [upload=271691]: Waiting for error group managing segments... Jan 28 12:48:20.625291889 (308h52m58.509246102s) [noise=true , address=81.171.14.70:4031 , piece_id=KGTVGUP4ABGFTZ24FNBYUCFXJBNJZYYSCHQXMUJ5CVVZFOWUVU4Q, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:20.627248883 (308h52m58.511203093s) [noise=true , address=185.167.204.206:4049 , piece_id=E6P2KJV4RJFZQ3C2YYI5TNGCCK6SQU3NL5QQK3TJ5MSFONVT6YZA, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:20.630083197 (308h52m58.51405153s) [noise=true , address=81.171.14.70:4027 , piece_id=6GOVQW4LFZIDRJ3PJ674Y37YOE6FE2TQRJYOYZFEUWZGSQTZHYCQ, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:20.635036680 (308h52m58.518990892s) [noise=true , address=185.167.204.205:4025 , piece_id=DS2AYROGDJ53FFTIZIAMJETFY6ZM5ZN2ZITVYGE4TWTPVYT7S5HA, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:20.636140374 (308h52m58.520094579s) [noise=true , address=185.167.204.205:4026 , piece_id=ZYEPTBC5JS7V26JWQU2LEGQGTT6HJCROY7GEH3BAXNKBAXAR4SOA, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:20.639500403 (308h52m58.523454613s) [noise=true , address=185.167.204.206:4041 , piece_id=FUNZ35BXXPIUU4YFCVAJ5IVFCYZUR2452DSQMKCXVB2ZZSLRLCIQ, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:20.639659764 (308h52m58.523613975s) [noise=true , address=185.167.204.206:4047 , piece_id=GBYULYNO5A3OF6CERM6UVEKTWAJFLREZSNPPQXJ72V557B7AA6EQ, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:20.640412731 (308h52m58.524366937s) [noise=true , address=81.171.14.70:4047 , piece_id=F4SVRYPR45YCGUMRIQMDFRH6J3GAQCIHZYQYUDXMNGIL35QX6SSQ, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:20.643400251 (308h52m58.527354452s) [noise=true , address=185.167.204.206:4072 , piece_id=6RQBWV6ENGQDXCY3U7N7MVBDMOVECXRIZKGCXANOET3PLLWGZU5Q, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:20.644514292 (308h52m58.528468501s) [noise=true , address=81.171.14.70:4042 , piece_id=5GFWQ53HT226EPGO43G6VRULSNYLQZRCYMEVJN3WSPRFF4ODRE5A, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:20.645454314 (308h52m58.529408519s) [noise=true , address=185.167.204.206:4056 , piece_id=VPPU2XMADTJVHMUSWFJN5UQ2E37F3226XNXFHFDKZIIVOIMXCZEA, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:20.645827740 (308h52m58.52978194s) [noise=true , address=185.167.204.206:4055 , piece_id=PX52LHHKNBLGDDDNUKURWX2XZMOYII7QLTYKQ2X4MV5H43X5FPCQ, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:20.650528830 (308h52m58.534483037s) [noise=true , address=81.171.14.70:4036 , piece_id=JPOALTDJMZWORGR2CROHT2UYBR3PTKRZD42UGI7CVKZGSY22QIAQ, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:20.650655124 (308h52m58.534609335s) [noise=true , address=185.167.204.206:4051 , piece_id=I2Y5C5OO4DGFKJHN324KI7IYS2CBJLOZOJTIGJ4BC2FMD2BXNXOA, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:20.654674091 (308h52m58.538628302s) [noise=true , address=185.167.204.205:4032 , piece_id=IFB6EZHERV4UONL66KQOAJFERI7QZSHMTPRX3MKSVBPZF2HRT34Q, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:20.667991310 (308h52m58.551945522s) [noise=true , address=185.167.204.205:4028 , piece_id=GMDIPHU3QHSLWTQFWET2A5US6P6L3H3ZHBCV7EPHKR2LMSC5HPLQ, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:20.685906061 (308h52m58.569860264s) [noise=true , address=81.171.14.70:4043 , piece_id=Z43F5XYK45B35UDMU2AQWB2JSSO2DSCGXDMFIQTOYJCE2OKW4NCA, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:21.125732283 (308h52m59.009686485s) [noise=true , address=81.171.14.70:4032 , piece_id=XAACRMXGGX7NUP2KYEGBG3HVI4Z532YSVASJAHAIAKCE4ZICYPIQ, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:21.145251537 (308h52m59.029205743s) [noise=true , address=89.149.201.147:4015 , piece_id=TJ3IEIVYA2WQY5NXFVUAUD7CMSGK3GE2S5F46NW3BTHLFK3GPDZQ, seg_pos={0 0}, upload=271691]: Done uploading piece. err: <nil> Jan 28 12:48:59.978775266 (308h53m37.862729472s) [noise=true , address=89.149.201.147:4007 , piece_id=6IYCG2ZWTZNWTYZ4INIXER2C2NVBH5K642DVJ2U56GQRQPOXGBBQ, seg_pos={0 0}, upload=271691]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 139.59.144.22:40572->89.149.201.147:4007: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:49:20.447094685 (308h53m58.331048901s) [noise=true , address=185.167.204.205:4012 , piece_id=53YRI4SCXYRTBK7VL6PBSAKVZ7M37LEKGCGC223VVHNFWCXMMEOQ, seg_pos={0 0}, upload=271691]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: read tcp 139.59.144.22:54624->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:49:20.447165019 (308h53m58.33111922s) [seg_pos={0 0}, upload=271691]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jan 28 12:49:20.462500708 (308h53m58.346454908s) [upload=271691]: Done uploading segments... Jan 28 12:49:20.462555776 (308h53m58.346509979s) [upload=271691]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 1m0.018831766s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 17 out of 60 is failed (threshold=3) [..........................................XXXXXXXXXXXXX.XXXX] duration: 1m0.018299805s trace: https://jaeger.dev.storj.io/trace/2a01090ba3adde8b FAIL (2026-01-28 12:48:20 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== h51m58.210107029s) [noise=true , address=81.171.14.70:4046 , piece_id=KTX6QF5PSVEYZHP3UZHJ6OCO2YIAFMGJVRRCNAPC742FFB4ZX4OQ, seg_pos={0 0}, upload=271676]: Uploading piece... Jan 28 12:47:20.326173707 (308h51m58.210127909s) [noise=true , address=185.167.204.206:4041 , piece_id=OFIYT2II3N5KZTS7FQVW4DH3DMJSGAJMFMXXDVDD5K6U6AUAA2IA, seg_pos={0 0}, upload=271676]: Uploading piece... Jan 28 12:47:20.326238029 (308h51m58.210192231s) [noise=true , address=185.167.204.206:4045 , piece_id=CN6UEP5E3L4SZD5OQ72LM23H7IOC7NR454R2HNRNJMHD2C567A3Q, seg_pos={0 0}, upload=271676]: Uploading piece... Jan 28 12:47:20.326711138 (308h51m58.210665348s) [noise=true , address=81.171.14.70:4038 , piece_id=3FLBJSVXNNY5Q3CDNJSV5S33UBKTG7CV4ZO7MVRNJ653D7BBTV6A, seg_pos={0 0}, upload=271676]: Uploading piece... Jan 28 12:47:20.327360500 (308h51m58.211314709s) [noise=true , address=185.167.204.205:4008 , piece_id=B6O24KFAFN7BBGXKSUIVSZXLAYXR6ZSGII5NCSWGL4AU5ZKU7LZQ, seg_pos={0 0}, upload=271676]: Uploading piece... Jan 28 12:47:20.327781728 (308h51m58.211735941s) [noise=true , address=185.167.204.206:4038 , piece_id=AGNMJUXLFFWSIOMII3626BAK6TMIMRQKTGOAMRAU44I34RP2Q3PQ, seg_pos={0 0}, upload=271676]: Uploading piece... Jan 28 12:47:20.328242263 (308h51m58.212196483s) [noise=true , address=185.167.204.206:4044 , piece_id=YY7YN4IUL4BM3FTYHGYTIMDU7ZU75UNZT2HKZACFE742HQB3UMKQ, seg_pos={0 0}, upload=271676]: Uploading piece... Jan 28 12:47:20.330350879 (308h51m58.214305082s) [noise=true , address=185.167.204.205:4030 , piece_id=FW2EOALJAA36DCSYLP5S32AN3XQUZWFKCGZQMO32CHQFLWT5TEMQ, seg_pos={0 0}, upload=271676]: Uploading piece... Jan 28 12:47:20.379960665 (308h51m58.263914889s) [noise=true , address=89.149.201.147:4008 , piece_id=V2QZNIFKTHQXXGQQ6SXXHHS7AMSXNICX3HWAJ7RVOPX5VHIQSWMA, seg_pos={0 0}, upload=271676]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: write tcp 139.59.144.22:39000->89.149.201.147:4008: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:47:20.384863307 (308h51m58.26881752s) [noise=true , address=89.149.201.147:4005 , piece_id=535H6EQWMW3H3U3MR6D4TOCYTFAHDB6OTBWATTGOKU3GQG6QNQAQ, seg_pos={0 0}, upload=271676]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: write tcp 139.59.144.22:50416->89.149.201.147:4005: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op Jan 28 12:47:20.397584935 (308h51m58.281539147s) [noise=true , address=185.167.204.205:4008 , piece_id=B6O24KFAFN7BBGXKSUIVSZXLAYXR6ZSGII5NCSWGL4AU5ZKU7LZQ, seg_pos={0 0}, upload=271676]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: write tcp 139.59.144.22:38146->185.167.204.205:4008: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:47:20.466436312 (308h51m58.350390513s) [upload=271676]: Next returned nil segment Jan 28 12:47:20.466455311 (308h51m58.350409526s) [upload=271676]: Waiting for error group managing segments... Jan 28 12:47:20.490437721 (308h51m58.37439192s) [noise=true , address=185.167.204.206:4047 , piece_id=WDE64TLJC76N4257LQBUTMR76DP2SZPH53KNQ54QUUFNKH762GUA, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.494437599 (308h51m58.378391811s) [noise=true , address=81.171.14.70:4032 , piece_id=GX7732GINAR5TTFOOTZHS4VQLWYEQCL6ZYF4OEY4VYGRGP4QVMMA, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.499876725 (308h51m58.383830935s) [noise=true , address=81.171.14.70:4031 , piece_id=M5CN43WJLZ5KSRWM4TNFW7GADEJVEFIYMROOV7OW3WGV6KF7L35A, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.500760048 (308h51m58.384714257s) [noise=true , address=81.171.14.70:4025 , piece_id=2ICWZR6AHFEOF5ECCAXH56BVBQA2TI3AJZBJZ4LSCG2KUHOSVDIA, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.501404931 (308h51m58.385359143s) [noise=true , address=185.167.204.206:4041 , piece_id=OFIYT2II3N5KZTS7FQVW4DH3DMJSGAJMFMXXDVDD5K6U6AUAA2IA, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.502066293 (308h51m58.386020498s) [noise=true , address=185.167.204.205:4033 , piece_id=PFRN6MKIX3OF3XTPPGEUNU2O6546RWN7CEOD7RDSRRO2QMZ7ETEQ, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.502819717 (308h51m58.386773926s) [noise=true , address=185.167.204.206:4043 , piece_id=EG3SGWHZAKI3AJNI46QHTR73DJ2A72ALLBVLSCVLZF7C3PQ26W3A, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.503491810 (308h51m58.387446018s) [noise=true , address=185.167.204.206:4045 , piece_id=CN6UEP5E3L4SZD5OQ72LM23H7IOC7NR454R2HNRNJMHD2C567A3Q, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.504079644 (308h51m58.388033854s) [noise=true , address=89.149.201.147:4021 , piece_id=IP7INSEDEHABT3O5WELDQGS5FI2LVPVNLYPUESVHHRLBLXCYM2HA, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.507959910 (308h51m58.391914116s) [noise=true , address=185.167.204.206:4065 , piece_id=DNSJ44HC44BUI33DJPWFV5ZFT3HHR5CLTDT3KIF6PVEEPC4E5ADQ, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.508767866 (308h51m58.392722076s) [noise=true , address=81.171.14.70:4036 , piece_id=5SLNJ23PXXSGHDUUVLSSKRVCEVW4O3RWFSAQNIOKZB72ZEIJ5ULQ, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.509484732 (308h51m58.393438938s) [noise=true , address=81.171.14.70:4033 , piece_id=LINO4F5DU67FHIMKSFMBWGXTHWMF7JNJQGUIWMTMFYWNOLXJZHVQ, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.510104333 (308h51m58.394058544s) [noise=true , address=185.167.204.206:4044 , piece_id=YY7YN4IUL4BM3FTYHGYTIMDU7ZU75UNZT2HKZACFE742HQB3UMKQ, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.512070185 (308h51m58.396024398s) [noise=true , address=185.167.204.205:4030 , piece_id=FW2EOALJAA36DCSYLP5S32AN3XQUZWFKCGZQMO32CHQFLWT5TEMQ, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.515851626 (308h51m58.399805828s) [noise=true , address=185.167.204.206:4046 , piece_id=3CL3EIGGOW3YIOFWJWNPZLGFIXV3ZVQAKCN7XKSVSDU2YOYRFT4A, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.516740116 (308h51m58.400694317s) [noise=true , address=81.171.14.70:4038 , piece_id=3FLBJSVXNNY5Q3CDNJSV5S33UBKTG7CV4ZO7MVRNJ653D7BBTV6A, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.524636982 (308h51m58.408591193s) [noise=true , address=185.167.204.205:4026 , piece_id=47VJPMF4L4BEUTBFNSFNYG5S4YUWRELZLG4TZBIFGUGD3H7QCPCQ, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.546502401 (308h51m58.430456637s) [noise=true , address=185.167.204.206:4038 , piece_id=AGNMJUXLFFWSIOMII3626BAK6TMIMRQKTGOAMRAU44I34RP2Q3PQ, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.560077169 (308h51m58.444031382s) [noise=true , address=81.171.14.70:4041 , piece_id=SVONQ5Z6NQEJJU443PIG6M3RV4QLMUX3KOYXGWJ7HVQLLPVYSCAQ, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.950005514 (308h51m58.833959721s) [noise=true , address=81.171.14.70:4035 , piece_id=55O6LACNOYKTFAACAYVDLNSQPLMZNH2QJXT5J7XJW4NBGUC5SCBQ, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:20.972935649 (308h51m58.85688985s) [noise=true , address=81.171.14.70:4039 , piece_id=KMYWBR67MLG5H2ZQDGLAPTY4JWQKSPHITL4T4SPRXKB35IQHKSBQ, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:47:21.039593734 (308h51m58.923547947s) [noise=true , address=81.171.14.70:4046 , piece_id=KTX6QF5PSVEYZHP3UZHJ6OCO2YIAFMGJVRRCNAPC742FFB4ZX4OQ, seg_pos={0 0}, upload=271676]: Done uploading piece. err: <nil> Jan 28 12:48:08.587001218 (308h52m46.470955432s) [noise=true , address=89.149.201.147:4003 , piece_id=RGHZG3GFGZXMJPUDYRNJNMY4S7FTRB3TPCZRQ5HIO63TNKNEZQ2A, seg_pos={0 0}, upload=271676]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: read tcp 139.59.144.22:60682->89.149.201.147:4003: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:48:20.280935589 (308h52m58.164889792s) [noise=true , address=89.149.201.147:4007 , piece_id=KQ374BZ6DLAFURBMTLVMU3VDFYJ2SKEJOM2HFR6ZWEUMEETNKA2A, seg_pos={0 0}, upload=271676]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 139.59.144.22:54008->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:48:20.281433566 (308h52m58.165387793s) [noise=true , address=185.167.204.205:4010 , piece_id=HJVIFPGDR2UKGZJI22EYP75SUCTFIPUZUBPISBLBMNDGF3APJMWQ, seg_pos={0 0}, upload=271676]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:55086->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Jan 28 12:48:20.281497661 (308h52m58.165451847s) [seg_pos={0 0}, upload=271676]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Jan 28 12:48:20.295823355 (308h52m58.179777561s) [upload=271676]: Done uploading segments... Jan 28 12:48:20.295874848 (308h52m58.179829056s) [upload=271676]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 1m0.018320072s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 16 out of 60 is failed (threshold=3) [...........................................XXXXXXXXXXXXX.XXX] duration: 1m0.029532335s trace: https://jaeger.dev.storj.io/trace/29031683dcd41e5b FAIL (2026-01-28 12:47:20 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 16) ======LOGS====== FRYP5AVSSEYGT4PKZWLXTBUQ, seg_pos={0 0}, upload=271662]: Uploading piece... Jan 28 12:46:20.193581710 (308h50m58.077535916s) [noise=true , address=185.167.204.205:4020 , piece_id=MOGB7T27O2N4MZG7UM7WWUDICTGFEACBN4NSJX74XULX3BLW5CKQ, seg_pos={0 0}, upload=271662]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 139.59.144.22:59930->185.167.204.205:4020: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:46:20.193886011 (308h50m58.077840214s) [noise=true , address=89.149.201.147:4005 , piece_id=F5Y7RFBDZQZYEQZNOPRJVQQ2C2J5L424BHBHTGKAINPJECJTUPAQ, seg_pos={0 0}, upload=271662]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: write tcp 139.59.144.22:45812->89.149.201.147:4005: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:46:20.194274039 (308h50m58.078228244s) [noise=true , address=89.149.201.147:4008 , piece_id=I6HXG54RNPP3WTC2QUVCDHOP5VIHNKECE7CM2YYTHYXLW3NZFABA, seg_pos={0 0}, upload=271662]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: write tcp 139.59.144.22:60976->89.149.201.147:4008: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:46:20.200806157 (308h50m58.084760364s) [noise=true , address=89.149.201.147:4012 , piece_id=K474TG7KPFLDMPTG6SX2P3LFT7CAQRRKMN57LJ7ZY22LUJI4FKUQ, seg_pos={0 0}, upload=271662]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: write tcp 139.59.144.22:59906->89.149.201.147:4012: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:46:20.202666413 (308h50m58.086620641s) [noise=true , address=185.167.204.205:4008 , piece_id=GTB7AJBCVRLH53R6EZ5ST3XXKSL7CQNCB7N5PJW3W2WHZ66BZ44A, seg_pos={0 0}, upload=271662]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: write tcp 139.59.144.22:32950->185.167.204.205:4008: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:46:20.203987042 (308h50m58.087941271s) [noise=true , address=89.149.201.147:4016 , piece_id=ILJ257M4RN3SBKHYTX3WNWITSUXZKRP2RNNMYZV63QERPOZN35VQ, seg_pos={0 0}, upload=271662]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: write tcp 139.59.144.22:50690->89.149.201.147:4016: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:46:20.295358706 (308h50m58.179312915s) [upload=271662]: Next returned nil segment Jan 28 12:46:20.295376991 (308h50m58.179331201s) [upload=271662]: Waiting for error group managing segments... Jan 28 12:46:20.326946215 (308h50m58.21090042s) [noise=true , address=185.167.204.206:4056 , piece_id=BAUMUQXCWI7JZ2GMRGMWFTO4UPU2F4TDQSVRPY4OX75BRIAHFXTA, seg_pos={0 0}, upload=271662]: Done uploading piece. err: <nil> Jan 28 12:46:20.327816687 (308h50m58.211770883s) [noise=true , address=81.171.14.70:4047 , piece_id=SDFNOJQDQD6HTYIXCVFBIS24UGOJ6B3SZJE3Q7T3UQFUOVSXFW6Q, seg_pos={0 0}, upload=271662]: Done uploading piece. err: <nil> Jan 28 12:46:20.329227619 (308h50m58.213181829s) [noise=true , address=81.171.14.70:4035 , piece_id=6756TE7AVOFGRRUB5SSIAXLWQRJHCUNTKRQQ5A73YRD5UN7HOYLA, seg_pos={0 0}, upload=271662]: Done uploading piece. err: <nil> Jan 28 12:46:20.329398447 (308h50m58.213352654s) [noise=true , address=81.171.14.70:4048 , piece_id=XFL4MGPYF7ZJQ5OBOWNRF4P6YYT72OVHVPF2EUE2HGZPE55ZLYEA, seg_pos={0 0}, upload=271662]: Done uploading piece. err: <nil> Jan 28 12:46:20.331008522 (308h50m58.214962732s) [noise=true , address=185.167.204.206:4070 , piece_id=22XWJX4OPIQ3LQ34BEOM4EXL7RN73TJQQ6FOECSRG47U43G74ZDA, seg_pos={0 0}, upload=271662]: Done uploading piece. err: <nil> Jan 28 12:46:20.331302245 (308h50m58.215256446s) [noise=true , address=185.167.204.206:4064 , piece_id=KG72NQ7MUD5EWL4ZAWZFWBPO4CWMYFHUDGGMQZECS4AQDN45O4PQ, seg_pos={0 0}, upload=271662]: Done uploading piece. err: <nil> Jan 28 12:46:20.332798799 (308h50m58.216753003s) [noise=true , address=81.171.14.70:4028 , piece_id=MPNCFN3ETLNXIGPZDTX7RN3LURIQNJBOVDDDGXG3T2D6AVQ52KIQ, seg_pos={0 0}, upload=271662]: Done uploading piece. err: <nil> Jan 28 12:46:20.333261838 (308h50m58.217216049s) [noise=true , address=185.167.204.206:4051 , piece_id=XRTUOK3V2DOOYHPP454EKYHLZJIULFYTI2VTTOYCR42WMMEMR4RQ, seg_pos={0 0}, upload=271662]: Done uploading piece. err: <nil> Jan 28 12:46:20.333473223 (308h50m58.217427425s) [noise=true , address=185.167.204.205:4035 , piece_id=YDIODW2ASXD3HHJRZL7FONPQS4YYFK4DKHD6W5NXAYIEVRRJT7SA, seg_pos={0 0}, upload=271662]: Done uploading piece. err: <nil> Jan 28 12:46:20.336976937 (308h50m58.220931142s) [noise=true , address=185.167.204.206:4058 , piece_id=3KIJUTV5U6NEFVT7QCQ3G5EVCQ46MBOC5BHHVGORWAAYJQI4TLMA, seg_pos={0 0}, upload=271662]: Done uploading piece. err: <nil> Jan 28 12:46:20.340192229 (308h50m58.224146432s) [noise=true , address=185.167.204.205:4030 , piece_id=ZYS3ERQ7AKOKZF2NBAVUAAO43YWQEY76QUJL7HX3JMEBO3MBR3OA, seg_pos={0 0}, upload=271662]: Done uploading piece. err: <nil> Jan 28 12:46:20.340918443 (308h50m58.22487265s) [noise=true , address=185.167.204.206:4043 , piece_id=XROXG4HUSOUM3US4MPVZFUZQP46D2EQCKMW23AU7QTZIFX7R56EA, seg_pos={0 0}, upload=271662]: Done uploading piece. err: <nil> Jan 28 12:46:20.353060295 (308h50m58.237014486s) [noise=true , address=89.149.201.147:4024 , piece_id=HJ2NUG4XSIBIZCEAXBS5NJQ7U2CY2K2L25Z6CQM4JJWWEI27OLTQ, seg_pos={0 0}, upload=271662]: Done uploading piece. err: <nil> Jan 28 12:46:20.394226572 (308h50m58.278180773s) [noise=true , address=81.171.14.70:4032 , piece_id=J3DVPBAJ3UKYKBUDM5KL7JEL6EVEWERATIZRIZJUM4TMFKAOPDMQ, seg_pos={0 0}, upload=271662]: Done uploading piece. err: <nil> Jan 28 12:46:20.791032586 (308h50m58.674986799s) [noise=true , address=81.171.14.70:4040 , piece_id=AM3OGZNEUFABDBDJYQ4DTBI3YDSRFRYP5AVSSEYGT4PKZWLXTBUQ, seg_pos={0 0}, upload=271662]: Done uploading piece. err: <nil> Jan 28 12:46:20.867706486 (308h50m58.751660688s) [noise=true , address=81.171.14.70:4038 , piece_id=ZGPQLPNVW5LJ5DSLV26IG3U24MAJ5JFIILSXUAGGQHTUY7U37JWA, seg_pos={0 0}, upload=271662]: Done uploading piece. err: <nil> Jan 28 12:47:20.112879492 (308h51m57.996833701s) [noise=true , address=89.149.201.147:4020 , piece_id=VUQTZ5A4XBX6SE4OQE37NP6HK74BJXJGHUS2V7YNBTO5IR55PY4Q, seg_pos={0 0}, upload=271662]: Done uploading piece. err: ecclient: upload failed (node:12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, address:89.149.201.147:4020): protocol: read tcp 139.59.144.22:59260->89.149.201.147:4020: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:47:20.113211271 (308h51m57.997165483s) [noise=true , address=89.149.201.147:4014 , piece_id=5EJ5KLWMSIYKCYZSPCBCGT6KOHQEEAX2Q55MW22QJ6B2G6MHUMQA, seg_pos={0 0}, upload=271662]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 139.59.144.22:53426->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:47:20.113339977 (308h51m57.997294181s) [noise=true , address=89.149.201.147:4007 , piece_id=IABGG5EAPL7P4YDJ37IYNKYOX3WVA6V7DKSKOPBMX5FDJCEWZN7Q, seg_pos={0 0}, upload=271662]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 139.59.144.22:58432->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:47:20.113535066 (308h51m57.997489277s) [noise=true , address=185.167.204.205:4010 , piece_id=6RUAH4NHHD73ACRSCIIMHW4NOADTIY4IELGI4X243KKUW7KOP4PQ, seg_pos={0 0}, upload=271662]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:57018->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:47:20.113626168 (308h51m57.997580381s) [noise=true , address=89.149.201.147:4003 , piece_id=XHDBOWVXCCWFJCEYM3MW2SJ56PPA36TGP2HV4KRBTOA3BFUSWVEQ, seg_pos={0 0}, upload=271662]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: read tcp 139.59.144.22:51194->89.149.201.147:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:47:20.113790118 (308h51m57.997744325s) [noise=true , address=185.167.204.205:4021 , piece_id=OTJQXHWVHMUEBMQDTGCPA7BIBK2USCVB5JEVPV6BZ4CCXJT2NSBA, seg_pos={0 0}, upload=271662]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: read tcp 139.59.144.22:40540->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:47:20.113835870 (308h51m57.997790073s) [seg_pos={0 0}, upload=271662]: Done waiting for segment. successful: 16 optimal: 26 errs: <nil> Jan 28 12:47:20.140134692 (308h51m58.024088895s) [upload=271662]: Done uploading segments... Jan 28 12:47:20.140178418 (308h51m58.024132627s) [upload=271662]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 16) Duration: 1m0.029550857s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [............................................XXXXXXXXXXXXX.XX] duration: 1m0.01967366s trace: https://jaeger.dev.storj.io/trace/71dd5c27c85cc187 FAIL (2026-01-28 12:46:19 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Q, seg_pos={0 0}, upload=271648]: Uploading piece... Jan 28 12:45:20.016407923 (308h49m57.900362135s) [noise=true , address=185.167.204.206:4051 , piece_id=UKVKSZWZX5YZMFGK6ZSQKWLMJNIGVK5EJTRDEPDDDLMLHL2X5SBA, seg_pos={0 0}, upload=271648]: Uploading piece... Jan 28 12:45:20.020518483 (308h49m57.904472692s) [noise=true , address=185.167.204.206:4061 , piece_id=36IYNRSPI2P3X2P37PMC5GPLPYRDPM75H3VXJY5FZC7LJYVHMAZQ, seg_pos={0 0}, upload=271648]: Uploading piece... Jan 28 12:45:20.023233178 (308h49m57.907187383s) [noise=true , address=185.167.204.206:4041 , piece_id=KMHJSHLYT4ZJUHOMY4FPNNCLBCFC2ALGZLKFPCHALSZGRGJEMAJA, seg_pos={0 0}, upload=271648]: Uploading piece... Jan 28 12:45:20.026048166 (308h49m57.910002378s) [noise=true , address=81.171.14.70:4038 , piece_id=LHP7L22QMMAW6K56HALOQV62PFK4XLD6GSV3SHGHXIJ64P46NQVA, seg_pos={0 0}, upload=271648]: Uploading piece... Jan 28 12:45:20.029350342 (308h49m57.913304556s) [noise=true , address=185.167.204.205:4024 , piece_id=FDLWFKYKNPWUDWZS3J6FMUXZCR2GRQKVQBTLTSUGGLZSZCQINBSQ, seg_pos={0 0}, upload=271648]: Uploading piece... Jan 28 12:45:20.032118124 (308h49m57.916072329s) [noise=true , address=185.167.204.206:4037 , piece_id=VWKVK7FPHQUBKM66NTJKQXKWMVVZ66HMETCDG6PV3WAB4MGCTEQA, seg_pos={0 0}, upload=271648]: Uploading piece... Jan 28 12:45:20.033617134 (308h49m57.917571347s) [noise=true , address=81.171.14.70:4030 , piece_id=RPGSOE2HW5NZPRUDWXBYUWGSI42ZQFPKDJTL3XXPBFM5R5KYPCZQ, seg_pos={0 0}, upload=271648]: Uploading piece... Jan 28 12:45:20.035209090 (308h49m57.919163298s) [noise=true , address=185.167.204.205:4022 , piece_id=DKRJ7XSS4GFEQVYEQHI6MIODDUOUNNVWLCYMH2NZCBL6GYRSHVQA, seg_pos={0 0}, upload=271648]: Uploading piece... Jan 28 12:45:20.036622752 (308h49m57.920576966s) [noise=true , address=185.167.204.206:4063 , piece_id=YFUX3V3OLL3ZK4XEFME7D4G62SF74LNF6Y4XGH7EHS5HEIIRTTIQ, seg_pos={0 0}, upload=271648]: Uploading piece... Jan 28 12:45:20.066598869 (308h49m57.950553081s) [noise=true , address=89.149.201.147:4012 , piece_id=LE7JHJPREHDH54UCGAIVXUETUV6AFDSXSDVQ7LNRHPAEVSA3EWIQ, seg_pos={0 0}, upload=271648]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: write tcp 139.59.144.22:45786->89.149.201.147:4012: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:45:20.075630268 (308h49m57.959584473s) [noise=true , address=185.167.204.205:4008 , piece_id=VTJOXL4ISTEDI6Z4SXA5SOX3SHKSB6GTXYWWZWSIKQFGNWLZIXWA, seg_pos={0 0}, upload=271648]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: write tcp 139.59.144.22:54498->185.167.204.205:4008: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:45:20.097610050 (308h49m57.981564264s) [noise=true , address=89.149.201.147:4016 , piece_id=HVBZCCBCWIMCTQ7VLE4UH2LUENVBIWW4MIDXOMRGQY4K3Q55DOGA, seg_pos={0 0}, upload=271648]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: write tcp 139.59.144.22:49798->89.149.201.147:4016: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:45:20.167363057 (308h49m58.051317282s) [upload=271648]: Next returned nil segment Jan 28 12:45:20.167383575 (308h49m58.051337788s) [upload=271648]: Waiting for error group managing segments... Jan 28 12:45:20.194893030 (308h49m58.078847223s) [noise=true , address=185.167.204.206:4037 , piece_id=VWKVK7FPHQUBKM66NTJKQXKWMVVZ66HMETCDG6PV3WAB4MGCTEQA, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.198110756 (308h49m58.082064998s) [noise=true , address=185.167.204.205:4035 , piece_id=2PVJJOXYGLKUDER2O7ZL3XT3QLIFN2E64NXEOGZZVMQ2R6V4TO4Q, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.198232027 (308h49m58.082186233s) [noise=true , address=185.167.204.205:4022 , piece_id=DKRJ7XSS4GFEQVYEQHI6MIODDUOUNNVWLCYMH2NZCBL6GYRSHVQA, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.198397595 (308h49m58.082351798s) [noise=true , address=185.167.204.206:4053 , piece_id=L3ZH35DN5BUFPF2EQFGETWD5GJZH3KKCX33S2QCPTPQWXR54MIUA, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.198920477 (308h49m58.08287468s) [noise=true , address=185.167.204.206:4038 , piece_id=73OJ5N3OZ3Y7QZ26UJUC7BCFYXDDUK4CZJCRV3MJ7HK6C43EOQ2A, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.199066822 (308h49m58.083021026s) [noise=true , address=185.167.204.205:4034 , piece_id=HBNCODL4IY5VKIYSDPSLOCDRWKYLB2FCOZYI5V5QTG7WEDKDPXXA, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.199467720 (308h49m58.083421921s) [noise=true , address=81.171.14.70:4030 , piece_id=RPGSOE2HW5NZPRUDWXBYUWGSI42ZQFPKDJTL3XXPBFM5R5KYPCZQ, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.199559752 (308h49m58.083513955s) [noise=true , address=185.167.204.206:4063 , piece_id=YFUX3V3OLL3ZK4XEFME7D4G62SF74LNF6Y4XGH7EHS5HEIIRTTIQ, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.200984166 (308h49m58.08493837s) [noise=true , address=185.167.204.206:4059 , piece_id=UUXHFXNG2UVQ24JMBUXYXX2HYKLDDALO3VWOWZ64NF67SASZSHVA, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.201687897 (308h49m58.085642102s) [noise=true , address=185.167.204.206:4061 , piece_id=36IYNRSPI2P3X2P37PMC5GPLPYRDPM75H3VXJY5FZC7LJYVHMAZQ, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.205224115 (308h49m58.089178323s) [noise=true , address=185.167.204.205:4023 , piece_id=AULJLR4FZRMRICR6QIN47JPAX62GR7WPNX3MDQUCOJ3BHA42DD2A, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.206060501 (308h49m58.090014704s) [noise=true , address=81.171.14.70:4026 , piece_id=UN4WEOU52IHKPU3MFH6EBS57W4U3MNFNTPHPTOHWJYEKBVRJTLSA, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.206642847 (308h49m58.090597047s) [noise=true , address=81.171.14.70:4041 , piece_id=PR3VPYX5W776AECLH2HTJHCOGF4DCYUSXWAMMMWDJMHTWHHDM5GA, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.207771126 (308h49m58.091725331s) [noise=true , address=185.167.204.206:4041 , piece_id=KMHJSHLYT4ZJUHOMY4FPNNCLBCFC2ALGZLKFPCHALSZGRGJEMAJA, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.208799556 (308h49m58.092753766s) [noise=true , address=185.167.204.206:4046 , piece_id=YF3VSQGGTJUXKADLMJMWNDNM5O3GJDQ6YJ2IK5SVA4NIZK4XPZ2A, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.209455595 (308h49m58.093409809s) [noise=true , address=185.167.204.206:4057 , piece_id=O5RL6H3TIZ5L33G5J735KJV5DNIXBQ7OOEV2FTHZGV2JHQ5ISUXA, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.211737807 (308h49m58.095692009s) [noise=true , address=185.167.204.205:4027 , piece_id=AYI5NY2YIEF6CZGBBE2IVJYCH2KOKHMRB44JVUPGMRNZUAE4GMZA, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.216925097 (308h49m58.100879309s) [noise=true , address=185.167.204.206:4051 , piece_id=UKVKSZWZX5YZMFGK6ZSQKWLMJNIGVK5EJTRDEPDDDLMLHL2X5SBA, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.236686696 (308h49m58.120640904s) [noise=true , address=185.167.204.205:4024 , piece_id=FDLWFKYKNPWUDWZS3J6FMUXZCR2GRQKVQBTLTSUGGLZSZCQINBSQ, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.239050490 (308h49m58.123004712s) [noise=true , address=81.171.14.70:4038 , piece_id=LHP7L22QMMAW6K56HALOQV62PFK4XLD6GSV3SHGHXIJ64P46NQVA, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.244132672 (308h49m58.128086883s) [noise=true , address=185.167.204.206:4065 , piece_id=AECS5DHWVN75BPEZWZKWFJXNFK3GTPEGGLZLCJUSMW56IPQ5QA3A, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.679268524 (308h49m58.563222728s) [noise=true , address=89.149.201.147:4024 , piece_id=OSEBOPCDKINIFPQFC3PETT4TXW5NLCQSGK4V7BSEULTSGBG3672A, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:45:20.687231899 (308h49m58.5711861s) [noise=true , address=81.171.14.70:4036 , piece_id=FJXZHIVZDM5ZLNFGVII3EDP325RMQA6EP2FAPPZSVNTIQ4BZSL3A, seg_pos={0 0}, upload=271648]: Done uploading piece. err: <nil> Jan 28 12:46:19.958646800 (308h50m57.842601013s) [noise=true , address=89.149.201.147:4007 , piece_id=5KBXRNQEEFHSTWXR7H6DWDI2C32TCGHERWKKGXHRS4UXJB2YDIEQ, seg_pos={0 0}, upload=271648]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 139.59.144.22:44374->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:46:19.958742883 (308h50m57.842697086s) [noise=true , address=89.149.201.147:4002 , piece_id=YPIVB3AY5CPYOJTGVAARJ4YBETUUMSE7B4QCJQUV4NE47G4CNE7Q, seg_pos={0 0}, upload=271648]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 139.59.144.22:50436->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:46:19.958806110 (308h50m57.842760314s) [seg_pos={0 0}, upload=271648]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Jan 28 12:46:19.974343234 (308h50m57.858297436s) [upload=271648]: Done uploading segments... Jan 28 12:46:19.974393535 (308h50m57.858347747s) [upload=271648]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 1m0.019738677s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 14 out of 60 is failed (threshold=3) [.............................................XXXXXXXXXXXXX.X] duration: 1m0.027444357s trace: https://jaeger.dev.storj.io/trace/252c9d4cf8f31ff8 FAIL (2026-01-28 12:45:19 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 18) ======LOGS====== g piece... Jan 28 12:44:19.835028394 (308h48m57.718982631s) [noise=true , address=81.171.14.70:4028 , piece_id=POUGFG465LGLVUXYOMADLBZKEOTCJO2TXDGJF5267IGMCGM4VLQA, seg_pos={0 0}, upload=271632]: Uploading piece... Jan 28 12:44:19.836032766 (308h48m57.719986968s) [noise=true , address=89.149.201.147:4016 , piece_id=RRR4U6N2WLRIOYLQBWC2I4SN3PCITZHVHZF7W4IGRTGTGUJDIBBQ, seg_pos={0 0}, upload=271632]: Uploading piece... Jan 28 12:44:19.837984929 (308h48m57.721939129s) [noise=true , address=185.167.204.205:4010 , piece_id=MKFARFYZFKDIMVPHHYXAIDXPZPBMDAXZHLF7GGTDNF3R43X47M2A, seg_pos={0 0}, upload=271632]: Uploading piece... Jan 28 12:44:19.874240344 (308h48m57.758194534s) [noise=true , address=89.149.201.147:4008 , piece_id=DQVIG6CYQR56ZXYYYWEBIU67KUT5CYTOY5VFUBKOU7LOSDVVINNQ, seg_pos={0 0}, upload=271632]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: write tcp 139.59.144.22:51974->89.149.201.147:4008: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:44:19.874323493 (308h48m57.758277695s) [noise=true , address=89.149.201.147:4016 , piece_id=RRR4U6N2WLRIOYLQBWC2I4SN3PCITZHVHZF7W4IGRTGTGUJDIBBQ, seg_pos={0 0}, upload=271632]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: write tcp 139.59.144.22:40262->89.149.201.147:4016: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:44:19.876479277 (308h48m57.760433484s) [noise=true , address=185.167.204.205:4008 , piece_id=GT6BCMLNCDLNSVKQSEYQO4S6N6XI76S6OB7NMMTIRPW7V3EBUN3A, seg_pos={0 0}, upload=271632]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: write tcp 139.59.144.22:44986->185.167.204.205:4008: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:44:19.881507461 (308h48m57.765461666s) [noise=true , address=89.149.201.147:4006 , piece_id=TIT56KVY7JI4F4UQQNYCIMSJ7VR6N3GIL3AFDGHFB2L37RS5REXA, seg_pos={0 0}, upload=271632]: Done uploading piece. err: ecclient: upload failed (node:12YTf9jvAKd4gVTxTZC6gGLdXC17ygbrqvqoKtmPbtHyc65YjDU, address:89.149.201.147:4006): protocol: write tcp 139.59.144.22:36146->89.149.201.147:4006: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:44:19.881559572 (308h48m57.76551378s) [noise=true , address=185.167.204.205:4002 , piece_id=S3PIRJQYXQB45YHN2R27EPUO4VTQVCPNSS5ODQDEM7PV2P7ZZR2A, seg_pos={0 0}, upload=271632]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 139.59.144.22:57832->185.167.204.205:4002: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:44:19.886898047 (308h48m57.77085226s) [noise=true , address=185.167.204.205:4006 , piece_id=GRVZBC7GFGVHFTHA2BCZKKYRE73K5KD2DFOZROJNPBJFEMDOFQUA, seg_pos={0 0}, upload=271632]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: write tcp 139.59.144.22:53678->185.167.204.205:4006: write: connection refused; manager closed: conn closed: op Jan 28 12:44:19.962889180 (308h48m57.846843368s) [upload=271632]: Next returned nil segment Jan 28 12:44:19.962908722 (308h48m57.846862935s) [upload=271632]: Waiting for error group managing segments... Jan 28 12:44:19.983928833 (308h48m57.867883032s) [noise=true , address=89.149.201.147:4015 , piece_id=D7G3MCQAXFFZXDNEHIGSUVK5VSAPOTJKKLIUO7IYOJQBNAC6H3WQ, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:19.989346014 (308h48m57.873300213s) [noise=true , address=81.171.14.70:4042 , piece_id=XOU3GETKJJSTX4LSROVJIDKZUODBZ3PFVTHGZ25N7R2IWYEZW4RA, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:19.990807120 (308h48m57.874761324s) [noise=true , address=81.171.14.70:4035 , piece_id=LORGYGKZ737ZI3QYSRLDNS2TW3FCFYUXWJ5VFZQ246CMA33SUXBA, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:19.991479968 (308h48m57.875434168s) [noise=true , address=185.167.204.205:4033 , piece_id=W5E6XRZK3Y7YTC7PSPD2DDLCXEJJOMIWCXLCLS23KC3MCNLW6CKA, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:19.993644424 (308h48m57.87759861s) [noise=true , address=81.171.14.70:4028 , piece_id=POUGFG465LGLVUXYOMADLBZKEOTCJO2TXDGJF5267IGMCGM4VLQA, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:19.994540474 (308h48m57.878494673s) [noise=true , address=81.171.14.70:4040 , piece_id=B4BCHNZCMPBR3Y3YJZIML2BU4PMZ6EWT7WR6TFVUEDZRR5ADEINQ, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:19.996889493 (308h48m57.880843692s) [noise=true , address=185.167.204.206:4068 , piece_id=D4L4XY2VQR3GTGVA7AU46TOMCYNZOCJODTCJH5DRD2BHTPEZZTQQ, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:19.996935051 (308h48m57.880889253s) [noise=true , address=185.167.204.206:4070 , piece_id=XTAO4KQ5JXUIL6NXGMJTCNSNYI5G555PTLRIFKWBKB4ASY7TPDIQ, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:19.999485686 (308h48m57.883439876s) [noise=true , address=81.171.14.70:4041 , piece_id=2VRSRRSKEROXS7PNFT6HXCO3RTPPKNVVPZI2SYZFKQKZDE2DAZJA, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:20.001527236 (308h48m57.885481513s) [noise=true , address=81.171.14.70:4032 , piece_id=IONR44BRJZKJOJTY7JXOBZHFWUATXU3THMS4ZRCTZZQBJLVCF4QA, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:20.001692781 (308h48m57.885647001s) [noise=true , address=81.171.14.70:4026 , piece_id=HQVN5YAHOOGWBPHGRHIFMHXTHZFPSZ2UIOXQA5WZMDTLJ4TR2L3Q, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:20.006370767 (308h48m57.890324969s) [noise=true , address=185.167.204.205:4036 , piece_id=4IPIBVB7WUZO2JHZF3QDMP4JNRKGQD5YXHGKFLOMP357N6EDOWXA, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:20.006802074 (308h48m57.890756274s) [noise=true , address=81.171.14.70:4044 , piece_id=7JK564ACKC2IYBSLCU6LSMZCOP2IQAOEVVIVDECYS7KLU567KXRA, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:20.041790661 (308h48m57.925744865s) [noise=true , address=81.171.14.70:4045 , piece_id=UF7JRBMXKIJAWK2O5CZJKMFBAITDS6VECC75JBAA7YG6ERULBBGQ, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:20.470474020 (308h48m58.354428221s) [noise=true , address=81.171.14.70:4027 , piece_id=RQA6KYVWUUV2QQNKDMHDQKEA7MX5YJSZBJCV47SYAIFJKYWCE76Q, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:20.474792447 (308h48m58.358746648s) [noise=true , address=89.149.201.147:4021 , piece_id=GZBX477WTMRXB7GJ7EMH4MYIWTBQ5MKWXRVLGGIY3ZOAGMTMXMKQ, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:20.482278674 (308h48m58.366232863s) [noise=true , address=81.171.14.70:4046 , piece_id=4W5CLRGNBLJXVGEWEWEJU4DK5VOHNM2SZ7ODNO7ACFDWMYDBWZLA, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:44:20.549887181 (308h48m58.433841381s) [noise=true , address=185.167.204.205:4009 , piece_id=GCM774GWGEQYFEHF7OMU7OJUHLLZWIWG5CHEIZ65YFCAU7BMZPEQ, seg_pos={0 0}, upload=271632]: Done uploading piece. err: <nil> Jan 28 12:45:19.789682557 (308h49m57.67363677s) [noise=true , address=185.167.204.205:4004 , piece_id=RS6ABEBZ6CDT52UYWHSMOEFILQPZNMUH2QJERPTQ6OZ5GC4O63JA, seg_pos={0 0}, upload=271632]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 139.59.144.22:58038->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:45:19.789727568 (308h49m57.673681782s) [noise=true , address=185.167.204.205:4021 , piece_id=RDQUBU7EEFRMXSXZ22JKLUPLCMGH7OCKA5TQUOBGMVKB6F4PAOSA, seg_pos={0 0}, upload=271632]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: read tcp 139.59.144.22:41034->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:45:19.790005076 (308h49m57.673959291s) [noise=true , address=185.167.204.205:4010 , piece_id=MKFARFYZFKDIMVPHHYXAIDXPZPBMDAXZHLF7GGTDNF3R43X47M2A, seg_pos={0 0}, upload=271632]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:43634->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:45:19.790274592 (308h49m57.6742288s) [noise=true , address=89.149.201.147:4001 , piece_id=TWLAJCY6Z34WRF3GWJOA7BW4NEUD7A76G4ZCQHL5PTFZ3MIQMZ3Q, seg_pos={0 0}, upload=271632]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 139.59.144.22:44838->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:45:19.790314300 (308h49m57.674268488s) [seg_pos={0 0}, upload=271632]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil> Jan 28 12:45:19.812751645 (308h49m57.696705853s) [upload=271632]: Done uploading segments... Jan 28 12:45:19.812800547 (308h49m57.696754781s) [upload=271632]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18) Duration: 1m0.027479715s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 13 out of 60 is failed (threshold=3) [..............................................XXXXXXXXXXXXX.] duration: 943.087638ms trace: https://jaeger.dev.storj.io/trace/12c4aaff44a45dde FAIL (2026-01-28 12:43:46 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== EQUBYPL6ADWCPZJXHG3Q, seg_pos={0 0}, upload=271614]: Uploading piece... Jan 28 12:42:45.853481701 (308h47m23.737435911s) [noise=true , address=81.171.14.70:4025 , piece_id=LHZJ53JQCF4VOGBZ7LO7WHS3F7UUWNUBT6VH32Q3WBENISJB3E2A, seg_pos={0 0}, upload=271614]: Uploading piece... Jan 28 12:42:45.855566513 (308h47m23.739520723s) [noise=true , address=185.167.204.205:4016 , piece_id=EU2WQOLF2ZBWJYHB4HWWHMGTSNCP6C4F22NLK7RI3T3VA44AVF4A, seg_pos={0 0}, upload=271614]: Uploading piece... Jan 28 12:42:45.857650207 (308h47m23.741604418s) [noise=true , address=81.171.14.70:4034 , piece_id=5EM4QSCZI7U6JDOF3IHCMDX5ZENVEGUWDRLWYQ63KQ6O4MWBMLJQ, seg_pos={0 0}, upload=271614]: Uploading piece... Jan 28 12:42:45.859357201 (308h47m23.743311407s) [noise=true , address=185.167.204.206:4047 , piece_id=6FLABDO3PYLDR55VUQGR6UPWXTQRQVBSLBG3VXBY4YXPK7UZRQGQ, seg_pos={0 0}, upload=271614]: Uploading piece... Jan 28 12:42:45.876080075 (308h47m23.760034287s) [noise=true , address=89.149.201.147:4008 , piece_id=7G5GRMGGI6NOFYJTKLZ6KAD22D66BQQBINZUD2L7SVI35S6NFISA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: rpc: dial tcp 89.149.201.147:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:45.876776236 (308h47m23.760730449s) [noise=true , address=185.167.204.205:4017 , piece_id=X2DWDXEETN3QPUXVQV5UGFXDXJMXNB7EITNSO3ON7V3PQGQXVBYA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: rpc: dial tcp 185.167.204.205:4017: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:45.877684844 (308h47m23.761639053s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZJAX26JJBP5DQZY47CELXBE3H3PIWICRJESAPMGMV4ZTFJYAE3Q, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:39530->185.167.204.205:4013: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:45.879058728 (308h47m23.763012934s) [noise=true , address=185.167.204.205:4008 , piece_id=CWLDFYLKOXXDX4L7GCVBMI23WG6STFDQRDEXH567E4RY5BLRH7QA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: write tcp 139.59.144.22:58232->185.167.204.205:4008: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:45.885341738 (308h47m23.769295941s) [noise=true , address=185.167.204.205:4016 , piece_id=EU2WQOLF2ZBWJYHB4HWWHMGTSNCP6C4F22NLK7RI3T3VA44AVF4A, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: write tcp 139.59.144.22:59762->185.167.204.205:4016: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:45.885795362 (308h47m23.769749573s) [noise=true , address=89.149.201.147:4013 , piece_id=IQ3DG5WUTMRRWBCGZFVATOAEUYI7EEC6KB3FEOD75IFVJFWY444A, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: write tcp 139.59.144.22:52624->89.149.201.147:4013: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:45.931068912 (308h47m23.815023111s) [upload=271614]: Next returned nil segment Jan 28 12:42:45.931082099 (308h47m23.815036298s) [upload=271614]: Waiting for error group managing segments... Jan 28 12:42:45.949334047 (308h47m23.83328825s) [noise=true , address=81.171.14.70:4025 , piece_id=LHZJ53JQCF4VOGBZ7LO7WHS3F7UUWNUBT6VH32Q3WBENISJB3E2A, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.950341406 (308h47m23.834295619s) [noise=true , address=81.171.14.70:4035 , piece_id=UHOYAIXL45CU3JFAC7DH2VYGD3PSWMF47BBCIDWSBXZWAZXZEDCQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.960117618 (308h47m23.844071819s) [noise=true , address=81.171.14.70:4046 , piece_id=WX4C6NSDBUS4LXCEVMPFVFFWZ5ZKE5LHWRNS7QNA4IAB37PT7MRQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.962363025 (308h47m23.846317227s) [noise=true , address=185.167.204.206:4055 , piece_id=K663RYFJ3HLCSPV5NJFCI5AHKUD4FOEREBMMKX4DHNKYFEOQDK5A, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.962877494 (308h47m23.8468317s) [noise=true , address=185.167.204.205:4031 , piece_id=RAJ5N6JQFD6CWSJMT6AGGGGXBWSIH4ANQEJIYPVNINKEZCUPANVA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.963019728 (308h47m23.846973928s) [noise=true , address=185.167.204.206:4037 , piece_id=345VXQBGIYNJGTYECDBT7EJWATGAWYAW6BRPFLGKCJQFMTVH2KHQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.963583262 (308h47m23.84753746s) [noise=true , address=185.167.204.206:4051 , piece_id=R75I6TCMKM3OBL2JTGHTVYIOIGGFF7A4O665LXVQZBVT7KSFBHOQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.968364185 (308h47m23.85231839s) [noise=true , address=89.149.201.147:4023 , piece_id=JY3AGYOY5XBGTV7YFGHMNXOQDVQAPUMU4QHEB2KOLDCOCCT37ZTQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.968440915 (308h47m23.852395113s) [noise=true , address=81.171.14.70:4039 , piece_id=GTLRYBJIT7P4R2FJETHZPVGLQNCPJPT54WBUYCZTPNGAIWCVRGPA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.968865058 (308h47m23.852819249s) [noise=true , address=81.171.14.70:4037 , piece_id=X5IEDZJXZ7FN6P2OJFCBIWVFGXQEOVGDO2C5FA5RFCEPGJJORGTA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.973712013 (308h47m23.857666212s) [noise=true , address=81.171.14.70:4043 , piece_id=2X23YEKEFLA6NKPL57S47T4T3C4RO7ESS5UPFJINQSJ7ZRTEZPCA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.988052899 (308h47m23.872007101s) [noise=true , address=185.167.204.206:4047 , piece_id=6FLABDO3PYLDR55VUQGR6UPWXTQRQVBSLBG3VXBY4YXPK7UZRQGQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.989140038 (308h47m23.873094238s) [noise=true , address=185.167.204.206:4039 , piece_id=PPXXFIZ2QBSGWGFNLTIONBRW4XSSSKUDTM3XTBUIYUNM3YUSMVUQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.990036372 (308h47m23.873990571s) [noise=true , address=185.167.204.205:4022 , piece_id=WXQXS3DRK6QUTDMDKI2IQ2FVQBY7DWMV6Y7OAKZIZ2OM4B2TU6WA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.991623226 (308h47m23.875577425s) [noise=true , address=185.167.204.206:4057 , piece_id=7SDEXKKHH6554PSIOTVCWSR3LC2URVLYEDCTKOUSZS4VJTAGPH6A, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.997271762 (308h47m23.881225968s) [noise=true , address=185.167.204.205:4025 , piece_id=QXCWQI7FK3YDECIEMZS4GWS7WQ6AWIC6FC7QM57X676472MOYWKA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:46.000556462 (308h47m23.884510655s) [noise=true , address=185.167.204.206:4056 , piece_id=KP4MQ5PXSTQXD4PN7M7BFSHAM7Z4G2CPOG7VRU7OYNBTMSF7NTZQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:46.005039286 (308h47m23.888993488s) [noise=true , address=81.171.14.70:4034 , piece_id=5EM4QSCZI7U6JDOF3IHCMDX5ZENVEGUWDRLWYQ63KQ6O4MWBMLJQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:46.035433556 (308h47m23.919387754s) [noise=true , address=185.167.204.205:4024 , piece_id=JVMUJKIIHV32G5Q5JNEE4LJEMBYNOXLUA7HBSWTCZDQC3XVOUWFQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:43:45.782774540 (308h48m23.666728743s) [noise=true , address=89.149.201.147:4001 , piece_id=AF3EHCX7NCO724C2YTSVFAVU3LXWXOEVEQUBYPL6ADWCPZJXHG3Q, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 139.59.144.22:57248->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:43:45.783013685 (308h48m23.666967887s) [noise=true , address=89.149.201.147:4005 , piece_id=3WDWACQIF6QOJDNUMCFSDCIWRPS4BUTHSTRQV4MV43M5V7LN46OA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 139.59.144.22:43884->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:43:45.783220264 (308h48m23.667174467s) [noise=true , address=185.167.204.205:4014 , piece_id=26HBGZCBRL2BBSRDXUFHLMD3BCYQ75SYRW5HEJ4OK3BET5PGB7TQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: read tcp 139.59.144.22:49826->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:43:45.783274625 (308h48m23.667228815s) [seg_pos={0 0}, upload=271614]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jan 28 12:43:45.798793267 (308h48m23.682747467s) [upload=271614]: Done uploading segments... Jan 28 12:43:45.798826769 (308h48m23.682780969s) [upload=271614]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 943.106089ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 13 out of 60 is failed (threshold=3) [...............................................XXXXXXXXXXXXX] duration: 1m0.019641114s trace: https://jaeger.dev.storj.io/trace/12c4aaff44a45dde FAIL (2026-01-28 12:43:45 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== EQUBYPL6ADWCPZJXHG3Q, seg_pos={0 0}, upload=271614]: Uploading piece... Jan 28 12:42:45.853481701 (308h47m23.737435911s) [noise=true , address=81.171.14.70:4025 , piece_id=LHZJ53JQCF4VOGBZ7LO7WHS3F7UUWNUBT6VH32Q3WBENISJB3E2A, seg_pos={0 0}, upload=271614]: Uploading piece... Jan 28 12:42:45.855566513 (308h47m23.739520723s) [noise=true , address=185.167.204.205:4016 , piece_id=EU2WQOLF2ZBWJYHB4HWWHMGTSNCP6C4F22NLK7RI3T3VA44AVF4A, seg_pos={0 0}, upload=271614]: Uploading piece... Jan 28 12:42:45.857650207 (308h47m23.741604418s) [noise=true , address=81.171.14.70:4034 , piece_id=5EM4QSCZI7U6JDOF3IHCMDX5ZENVEGUWDRLWYQ63KQ6O4MWBMLJQ, seg_pos={0 0}, upload=271614]: Uploading piece... Jan 28 12:42:45.859357201 (308h47m23.743311407s) [noise=true , address=185.167.204.206:4047 , piece_id=6FLABDO3PYLDR55VUQGR6UPWXTQRQVBSLBG3VXBY4YXPK7UZRQGQ, seg_pos={0 0}, upload=271614]: Uploading piece... Jan 28 12:42:45.876080075 (308h47m23.760034287s) [noise=true , address=89.149.201.147:4008 , piece_id=7G5GRMGGI6NOFYJTKLZ6KAD22D66BQQBINZUD2L7SVI35S6NFISA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: rpc: dial tcp 89.149.201.147:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:45.876776236 (308h47m23.760730449s) [noise=true , address=185.167.204.205:4017 , piece_id=X2DWDXEETN3QPUXVQV5UGFXDXJMXNB7EITNSO3ON7V3PQGQXVBYA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: rpc: dial tcp 185.167.204.205:4017: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:45.877684844 (308h47m23.761639053s) [noise=true , address=185.167.204.205:4013 , piece_id=6ZJAX26JJBP5DQZY47CELXBE3H3PIWICRJESAPMGMV4ZTFJYAE3Q, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:39530->185.167.204.205:4013: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:45.879058728 (308h47m23.763012934s) [noise=true , address=185.167.204.205:4008 , piece_id=CWLDFYLKOXXDX4L7GCVBMI23WG6STFDQRDEXH567E4RY5BLRH7QA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: write tcp 139.59.144.22:58232->185.167.204.205:4008: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:45.885341738 (308h47m23.769295941s) [noise=true , address=185.167.204.205:4016 , piece_id=EU2WQOLF2ZBWJYHB4HWWHMGTSNCP6C4F22NLK7RI3T3VA44AVF4A, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: write tcp 139.59.144.22:59762->185.167.204.205:4016: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:45.885795362 (308h47m23.769749573s) [noise=true , address=89.149.201.147:4013 , piece_id=IQ3DG5WUTMRRWBCGZFVATOAEUYI7EEC6KB3FEOD75IFVJFWY444A, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: write tcp 139.59.144.22:52624->89.149.201.147:4013: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:45.931068912 (308h47m23.815023111s) [upload=271614]: Next returned nil segment Jan 28 12:42:45.931082099 (308h47m23.815036298s) [upload=271614]: Waiting for error group managing segments... Jan 28 12:42:45.949334047 (308h47m23.83328825s) [noise=true , address=81.171.14.70:4025 , piece_id=LHZJ53JQCF4VOGBZ7LO7WHS3F7UUWNUBT6VH32Q3WBENISJB3E2A, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.950341406 (308h47m23.834295619s) [noise=true , address=81.171.14.70:4035 , piece_id=UHOYAIXL45CU3JFAC7DH2VYGD3PSWMF47BBCIDWSBXZWAZXZEDCQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.960117618 (308h47m23.844071819s) [noise=true , address=81.171.14.70:4046 , piece_id=WX4C6NSDBUS4LXCEVMPFVFFWZ5ZKE5LHWRNS7QNA4IAB37PT7MRQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.962363025 (308h47m23.846317227s) [noise=true , address=185.167.204.206:4055 , piece_id=K663RYFJ3HLCSPV5NJFCI5AHKUD4FOEREBMMKX4DHNKYFEOQDK5A, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.962877494 (308h47m23.8468317s) [noise=true , address=185.167.204.205:4031 , piece_id=RAJ5N6JQFD6CWSJMT6AGGGGXBWSIH4ANQEJIYPVNINKEZCUPANVA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.963019728 (308h47m23.846973928s) [noise=true , address=185.167.204.206:4037 , piece_id=345VXQBGIYNJGTYECDBT7EJWATGAWYAW6BRPFLGKCJQFMTVH2KHQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.963583262 (308h47m23.84753746s) [noise=true , address=185.167.204.206:4051 , piece_id=R75I6TCMKM3OBL2JTGHTVYIOIGGFF7A4O665LXVQZBVT7KSFBHOQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.968364185 (308h47m23.85231839s) [noise=true , address=89.149.201.147:4023 , piece_id=JY3AGYOY5XBGTV7YFGHMNXOQDVQAPUMU4QHEB2KOLDCOCCT37ZTQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.968440915 (308h47m23.852395113s) [noise=true , address=81.171.14.70:4039 , piece_id=GTLRYBJIT7P4R2FJETHZPVGLQNCPJPT54WBUYCZTPNGAIWCVRGPA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.968865058 (308h47m23.852819249s) [noise=true , address=81.171.14.70:4037 , piece_id=X5IEDZJXZ7FN6P2OJFCBIWVFGXQEOVGDO2C5FA5RFCEPGJJORGTA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.973712013 (308h47m23.857666212s) [noise=true , address=81.171.14.70:4043 , piece_id=2X23YEKEFLA6NKPL57S47T4T3C4RO7ESS5UPFJINQSJ7ZRTEZPCA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.988052899 (308h47m23.872007101s) [noise=true , address=185.167.204.206:4047 , piece_id=6FLABDO3PYLDR55VUQGR6UPWXTQRQVBSLBG3VXBY4YXPK7UZRQGQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.989140038 (308h47m23.873094238s) [noise=true , address=185.167.204.206:4039 , piece_id=PPXXFIZ2QBSGWGFNLTIONBRW4XSSSKUDTM3XTBUIYUNM3YUSMVUQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.990036372 (308h47m23.873990571s) [noise=true , address=185.167.204.205:4022 , piece_id=WXQXS3DRK6QUTDMDKI2IQ2FVQBY7DWMV6Y7OAKZIZ2OM4B2TU6WA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.991623226 (308h47m23.875577425s) [noise=true , address=185.167.204.206:4057 , piece_id=7SDEXKKHH6554PSIOTVCWSR3LC2URVLYEDCTKOUSZS4VJTAGPH6A, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:45.997271762 (308h47m23.881225968s) [noise=true , address=185.167.204.205:4025 , piece_id=QXCWQI7FK3YDECIEMZS4GWS7WQ6AWIC6FC7QM57X676472MOYWKA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:46.000556462 (308h47m23.884510655s) [noise=true , address=185.167.204.206:4056 , piece_id=KP4MQ5PXSTQXD4PN7M7BFSHAM7Z4G2CPOG7VRU7OYNBTMSF7NTZQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:46.005039286 (308h47m23.888993488s) [noise=true , address=81.171.14.70:4034 , piece_id=5EM4QSCZI7U6JDOF3IHCMDX5ZENVEGUWDRLWYQ63KQ6O4MWBMLJQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:42:46.035433556 (308h47m23.919387754s) [noise=true , address=185.167.204.205:4024 , piece_id=JVMUJKIIHV32G5Q5JNEE4LJEMBYNOXLUA7HBSWTCZDQC3XVOUWFQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: <nil> Jan 28 12:43:45.782774540 (308h48m23.666728743s) [noise=true , address=89.149.201.147:4001 , piece_id=AF3EHCX7NCO724C2YTSVFAVU3LXWXOEVEQUBYPL6ADWCPZJXHG3Q, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 139.59.144.22:57248->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:43:45.783013685 (308h48m23.666967887s) [noise=true , address=89.149.201.147:4005 , piece_id=3WDWACQIF6QOJDNUMCFSDCIWRPS4BUTHSTRQV4MV43M5V7LN46OA, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 139.59.144.22:43884->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:43:45.783220264 (308h48m23.667174467s) [noise=true , address=185.167.204.205:4014 , piece_id=26HBGZCBRL2BBSRDXUFHLMD3BCYQ75SYRW5HEJ4OK3BET5PGB7TQ, seg_pos={0 0}, upload=271614]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: read tcp 139.59.144.22:49826->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:43:45.783274625 (308h48m23.667228815s) [seg_pos={0 0}, upload=271614]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jan 28 12:43:45.798793267 (308h48m23.682747467s) [upload=271614]: Done uploading segments... Jan 28 12:43:45.798826769 (308h48m23.682780969s) [upload=271614]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 1m0.019724703s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 12 out of 60 is failed (threshold=3) [................................................XXXXXXXXXXXX] duration: 1m0.060723368s trace: https://jaeger.dev.storj.io/trace/28ffb458bb8cc593 FAIL (2026-01-28 12:42:43 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== =185.167.204.205:4006 , piece_id=FSBP2EZAXSIAHWKFAFZEZ6WBAOXDIXJHAYODMF2EHUR3QIYWWL7Q, seg_pos={0 0}, upload=271599]: Uploading piece... Jan 28 12:41:43.773473122 (308h46m21.657427334s) [noise=true , address=185.167.204.206:4057 , piece_id=UV7OZRGOIZ4WTUQE3TOYSE53NIKU2HKBRKBKFNSS6GAZVKGASSEQ, seg_pos={0 0}, upload=271599]: Uploading piece... Jan 28 12:41:43.793507828 (308h46m21.677462037s) [noise=true , address=89.149.201.147:4013 , piece_id=DXJZEDKCZ4KQAWFIDXCNDMVDNCWQQMUVOOUKPTDZGRUXHXR4ZCYA, seg_pos={0 0}, upload=271599]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: write tcp 139.59.144.22:59140->89.149.201.147:4013: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:41:43.795321988 (308h46m21.679276198s) [noise=true , address=89.149.201.147:4008 , piece_id=TJYSY3IFP7BYC5U6LF3ITYDC6Z5SSFBGFP72Q2ZUBIH44BLLCUIQ, seg_pos={0 0}, upload=271599]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: write tcp 139.59.144.22:34720->89.149.201.147:4008: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:41:43.796298610 (308h46m21.68025282s) [noise=true , address=185.167.204.205:4006 , piece_id=FSBP2EZAXSIAHWKFAFZEZ6WBAOXDIXJHAYODMF2EHUR3QIYWWL7Q, seg_pos={0 0}, upload=271599]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:41:43.799164440 (308h46m21.683118648s) [noise=true , address=89.149.201.147:4018 , piece_id=ON7BL7T6FG7AX4VWP25DOTVPY2G2S57IRVR5W7XRUKHB3CUDYSYQ, seg_pos={0 0}, upload=271599]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: write tcp 139.59.144.22:41844->89.149.201.147:4018: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:41:43.801497420 (308h46m21.685451629s) [noise=true , address=89.149.201.147:4011 , piece_id=S5LI43X37M742E4VCDPSKNJUYJQIQW3JOATIERS37EG3LNYHX2VA, seg_pos={0 0}, upload=271599]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 139.59.144.22:55058->89.149.201.147:4011: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:41:43.853873111 (308h46m21.737827299s) [upload=271599]: Next returned nil segment Jan 28 12:41:43.853890252 (308h46m21.73784446s) [upload=271599]: Waiting for error group managing segments... Jan 28 12:41:43.883150798 (308h46m21.767105004s) [noise=true , address=81.171.14.70:4036 , piece_id=LKJAJAKFOKVN54V747TQXFIM3XVVMSZEQTNE6YY5CVLW3RUF7ZJA, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:41:43.883897103 (308h46m21.767851314s) [noise=true , address=89.149.201.147:4023 , piece_id=AIGTZ7HKOREXBQN53FB4Y37O47PRNGOWDT2ELVE3VT3G2GJ3ABOA, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:41:43.897321501 (308h46m21.781275727s) [noise=true , address=185.167.204.206:4068 , piece_id=KLRSAOCBBDHBOWT2OY7JB3WJSKADATQ64LHFUHIJPIALDGS6V3RA, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:41:43.899763268 (308h46m21.783717468s) [noise=true , address=185.167.204.206:4056 , piece_id=PUMBMJSN2NXG55TWQAWU53CQY5DZ54EKOHWRGM7WRCFNIJZCQQBQ, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:41:43.900526838 (308h46m21.784481041s) [noise=true , address=185.167.204.206:4060 , piece_id=BEH6QEZX76WKHJORKGWBCW7YD5A5KHC7AKJUQKOYIVIGLQ7UO3TA, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:41:43.909190242 (308h46m21.793144468s) [noise=true , address=81.171.14.70:4041 , piece_id=X54AM7EXYIY7HUKST4AJUZZCAK5M2OZ77ZZFS5SH6P33DH3YZF7A, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:41:43.912049748 (308h46m21.796003951s) [noise=true , address=81.171.14.70:4044 , piece_id=INURD25R5LXAEHWXVNFBHIQ5UHTBG2XTTDO3JNDR3APRF3AST7LQ, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:41:43.915649182 (308h46m21.799603389s) [noise=true , address=185.167.204.206:4062 , piece_id=7PEZRN67LXJEQEXK5BVKQ7AD7XNLJI4UCD4BYNUEUK2GZD5IKWTA, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:41:43.916139525 (308h46m21.800093727s) [noise=true , address=185.167.204.206:4057 , piece_id=UV7OZRGOIZ4WTUQE3TOYSE53NIKU2HKBRKBKFNSS6GAZVKGASSEQ, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:41:43.920714489 (308h46m21.804668698s) [noise=true , address=89.149.201.147:4022 , piece_id=AINCATTE64YC3KOAHT4AZHMCOAMCFOOVQZAUC2MGLYFHMN27SLZA, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:41:43.929252365 (308h46m21.813206573s) [noise=true , address=81.171.14.70:4038 , piece_id=ANWOOYMZ4UWMYTSGADCCGJHQ7XSSVC5P6TS4H36HV7Y4UHJATQCA, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:41:43.930098290 (308h46m21.814052492s) [noise=true , address=185.167.204.206:4039 , piece_id=7UPMTDVSSV4NHLCX4BRLIHPRLSNQNQQ2LPQJ4HJNDXT2SQHUPCUA, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:41:43.935863163 (308h46m21.819817363s) [noise=true , address=81.171.14.70:4028 , piece_id=432FMLWCSEOYD4EOQ3D7FXAHHS3KJFBH6I2GRMA4ETSXN2LCGRHA, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:41:43.990487636 (308h46m21.874441822s) [noise=true , address=185.167.204.206:4038 , piece_id=OQ3IR7GLF6RXXZHP3MHYLUNUIYQ5HEOKMWYC7CGPF4BATIQ4PHBQ, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:41:44.331834742 (308h46m22.21578894s) [noise=true , address=81.171.14.70:4035 , piece_id=5XRZYWM445V4P6DOHOWRWKKHLPXVO2CKGCBRSXREA7ZZ3Y7QY73Q, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:41:44.381528560 (308h46m22.265482763s) [noise=true , address=81.171.14.70:4025 , piece_id=HSVPN47VDMKH6TQTWGFIH42TID626UBCYNLQ7LMWAH5HYTNT4KCQ, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:41:44.433294726 (308h46m22.317248958s) [noise=true , address=81.171.14.70:4048 , piece_id=O57EUJKCKOGZT6AC7UIOHLYRGHOKCUAR6IDLVR3PZOKXD72XAKUQ, seg_pos={0 0}, upload=271599]: Done uploading piece. err: <nil> Jan 28 12:42:43.695858268 (308h47m21.579812468s) [noise=true , address=89.149.201.147:4004 , piece_id=7YC5QJIHMVN7F4PL55DVBHIH45VE7B6Z7HDUQLCLDXQKYP6PVZ2A, seg_pos={0 0}, upload=271599]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 139.59.144.22:56792->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:43.695924374 (308h47m21.579878578s) [noise=true , address=89.149.201.147:4005 , piece_id=4JZFOIJSZ5SPYUOYYLY4A7WDXAF3L3UNCDOCPC4QNFANMIA4IFHA, seg_pos={0 0}, upload=271599]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 139.59.144.22:40738->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:43.696273481 (308h47m21.580227686s) [noise=true , address=185.167.204.205:4010 , piece_id=VUO3EEWVA6EOMIUF62SWF45R27EWDOLHK634ZMDZH446ZL3PFNPA, seg_pos={0 0}, upload=271599]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 139.59.144.22:58042->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:43.696599547 (308h47m21.580553752s) [noise=true , address=185.167.204.205:4014 , piece_id=EI7TRSH6HDYC2TZLINHUOGCAHYZSMYZD34SGV3Q6JCWQUCSAHPZA, seg_pos={0 0}, upload=271599]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: read tcp 139.59.144.22:45962->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:43.696723519 (308h47m21.580677721s) [noise=true , address=89.149.201.147:4014 , piece_id=AW7GS663NQGQVYZY2ISSTXX657WN52UFLLNO7LUIFEWAGZSUHLNQ, seg_pos={0 0}, upload=271599]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 139.59.144.22:60956->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:42:43.696988739 (308h47m21.580942945s) [noise=true , address=89.149.201.147:4009 , piece_id=4SWVMLSVWZSTGVT2VOYXXYECTQBMIW3MEW6YJGKOYPSAPVTUDCPQ, seg_pos={0 0}, upload=271599]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: read tcp 139.59.144.22:46956->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Jan 28 12:42:43.697017417 (308h47m21.58097161s) [seg_pos={0 0}, upload=271599]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Jan 28 12:42:43.754144780 (308h47m21.638098982s) [upload=271599]: Done uploading segments... Jan 28 12:42:43.754196909 (308h47m21.638151111s) [upload=271599]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 1m0.06073766s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [.................................................XXXXXXXXXXX] duration: 1m0.189987599s trace: https://jaeger.dev.storj.io/trace/73b11f9eb1ecee8a FAIL (2026-01-28 12:41:43 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 7IBUZH2N7VA, seg_pos={0 0}, upload=271583]: Uploading piece... Jan 28 12:40:43.404745337 (308h45m21.288699572s) [noise=true , address=185.167.204.205:4018 , piece_id=MQXIQNOVACQINOIUYZH3XFQZPOF6IWJGBGOFYM3G257N5SK56HIA, seg_pos={0 0}, upload=271583]: Uploading piece... Jan 28 12:40:43.404906614 (308h45m21.288860824s) [noise=true , address=89.149.201.147:4006 , piece_id=OKRY5JDNGIZHO2LI6H7557CCCHGGCW4XVEY4EOHNQUKDI3IUXS5Q, seg_pos={0 0}, upload=271583]: Uploading piece... Jan 28 12:40:43.405295607 (308h45m21.289249798s) [noise=true , address=185.167.204.206:4071 , piece_id=YOA45QIPCGT6JDRTKOLKECYP452HMEBSL4XFHP4AASBNGUUXK5WQ, seg_pos={0 0}, upload=271583]: Uploading piece... Jan 28 12:40:43.405412756 (308h45m21.289366962s) [noise=true , address=185.167.204.205:4030 , piece_id=APBB4NPEKETTY2GNIAJ7XCP76VUVJ454DWCI6GRPSGBUJ63MQC6A, seg_pos={0 0}, upload=271583]: Uploading piece... Jan 28 12:40:43.405670151 (308h45m21.289624341s) [noise=true , address=185.167.204.206:4070 , piece_id=HMVIENI2WM2FFJUNX5KHAILROKFJS7HQ23OAC3ROIH6JARXR2OTQ, seg_pos={0 0}, upload=271583]: Uploading piece... Jan 28 12:40:43.406122760 (308h45m21.290076964s) [noise=true , address=81.171.14.70:4037 , piece_id=SEKGB35K5BM6YXK2GQKCZRF3M4FFXVAFPR4KLNF3YKBHS3C75Y4A, seg_pos={0 0}, upload=271583]: Uploading piece... Jan 28 12:40:43.407034340 (308h45m21.290988545s) [noise=true , address=185.167.204.205:4027 , piece_id=FY6I3BG2N4SMBTH3KWD7FILVNPGCABFV5SFDWO4RTWAU5XCQCUNQ, seg_pos={0 0}, upload=271583]: Uploading piece... Jan 28 12:40:43.407543722 (308h45m21.291497928s) [noise=true , address=81.171.14.70:4030 , piece_id=2VL5QIIFYPOTEL34FUDF2DCD53E6AVIF2FJPO72WSCGBF6NQL2BQ, seg_pos={0 0}, upload=271583]: Uploading piece... Jan 28 12:40:43.430885503 (308h45m21.314839714s) [noise=true , address=185.167.204.205:4016 , piece_id=UTXYG54M6H6KIFIN63R3YIXWSJLDVOQYCZRGGAJ2TQPKBROTT63Q, seg_pos={0 0}, upload=271583]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: write tcp 139.59.144.22:45180->185.167.204.205:4016: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:40:43.436692487 (308h45m21.320646699s) [noise=true , address=89.149.201.147:4013 , piece_id=64YXJ7MDCVELHCN4ZII755AFXTTR6NQFYWUOR5DGCYWTX35ACP4A, seg_pos={0 0}, upload=271583]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: write tcp 139.59.144.22:43714->89.149.201.147:4013: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:40:43.437457654 (308h45m21.321411861s) [noise=true , address=185.167.204.205:4018 , piece_id=MQXIQNOVACQINOIUYZH3XFQZPOF6IWJGBGOFYM3G257N5SK56HIA, seg_pos={0 0}, upload=271583]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:46028->185.167.204.205:4018: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op Jan 28 12:40:43.443020193 (308h45m21.326974402s) [noise=true , address=89.149.201.147:4006 , piece_id=OKRY5JDNGIZHO2LI6H7557CCCHGGCW4XVEY4EOHNQUKDI3IUXS5Q, seg_pos={0 0}, upload=271583]: Done uploading piece. err: ecclient: upload failed (node:12YTf9jvAKd4gVTxTZC6gGLdXC17ygbrqvqoKtmPbtHyc65YjDU, address:89.149.201.147:4006): protocol: write tcp 139.59.144.22:54138->89.149.201.147:4006: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:40:43.448594824 (308h45m21.332549032s) [noise=true , address=185.167.204.205:4002 , piece_id=SDUXIFN74X5IDRFOADJZMG2W5OHNPGFSDZ2N7TCGWOU7ZE2LEMCQ, seg_pos={0 0}, upload=271583]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 139.59.144.22:58816->185.167.204.205:4002: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op Jan 28 12:40:43.496127618 (308h45m21.380081808s) [upload=271583]: Next returned nil segment Jan 28 12:40:43.496142070 (308h45m21.38009627s) [upload=271583]: Waiting for error group managing segments... Jan 28 12:40:43.521990331 (308h45m21.405944531s) [noise=true , address=81.171.14.70:4037 , piece_id=SEKGB35K5BM6YXK2GQKCZRF3M4FFXVAFPR4KLNF3YKBHS3C75Y4A, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.524776781 (308h45m21.408730983s) [noise=true , address=185.167.204.205:4027 , piece_id=FY6I3BG2N4SMBTH3KWD7FILVNPGCABFV5SFDWO4RTWAU5XCQCUNQ, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.526566572 (308h45m21.410520782s) [noise=true , address=185.167.204.205:4028 , piece_id=VSYEWNPE7IMTF3OSVKIMU36BNL4W42MHHMU6Y5NDAAM3DFQSKUJA, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.527508516 (308h45m21.411462724s) [noise=true , address=185.167.204.206:4071 , piece_id=YOA45QIPCGT6JDRTKOLKECYP452HMEBSL4XFHP4AASBNGUUXK5WQ, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.527560314 (308h45m21.411514518s) [noise=true , address=185.167.204.206:4046 , piece_id=TTTACNRGWPOD2AQ5K4F7MD4U24QC3KBRVDUCPL4WL3ZKBC22YWFQ, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.528118466 (308h45m21.412072661s) [noise=true , address=185.167.204.206:4058 , piece_id=HDA2HZXGOJ3MVICSNGNO6BIVM35JANX3V6YZBCBJKJDJORXBLVHA, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.529439098 (308h45m21.413393304s) [noise=true , address=185.167.204.206:4061 , piece_id=IB533VXXOTWULZZIPRWL4H5KZHM4GBINVTTEES7WDVMNLF3OCSJA, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.530069788 (308h45m21.414023989s) [noise=true , address=81.171.14.70:4046 , piece_id=O4OJK3DG4FRH3THVHPVCX4NO67NIYHN76CQ7B3INNE2PACMOIAQQ, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.530184354 (308h45m21.414138558s) [noise=true , address=185.167.204.206:4053 , piece_id=CSL7UB57CT2BJ532DVU4X5EA36KK767IZ3MXNUNGT3LR45UZILLQ, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.541411889 (308h45m21.425366079s) [noise=true , address=81.171.14.70:4047 , piece_id=NUSLU5P4KKJEOEHBZJLBK3ZZLF5IZL5XDCLX4UAJH7IBUZH2N7VA, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.553602902 (308h45m21.437557103s) [noise=true , address=185.167.204.206:4062 , piece_id=YJDIE6XBK47N4ECNW6BSGWMJMYQB4HJ7XHHUSYRET3KDO2KTJ6HA, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.556736119 (308h45m21.440690319s) [noise=true , address=81.171.14.70:4032 , piece_id=JDHD2CUPTU7ON4BTKROOUV7CA6BZNJ4EIQHLJRGUN5JNJKBYPXCA, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.563011461 (308h45m21.44696566s) [noise=true , address=81.171.14.70:4030 , piece_id=2VL5QIIFYPOTEL34FUDF2DCD53E6AVIF2FJPO72WSCGBF6NQL2BQ, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.563564643 (308h45m21.447518845s) [noise=true , address=185.167.204.206:4043 , piece_id=RVEERNRXSN5RYAPKKQWGTKQ7JCYQWVYU763EZ3GIE4X73KZ2VGAQ, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.570138628 (308h45m21.454092818s) [noise=true , address=185.167.204.205:4030 , piece_id=APBB4NPEKETTY2GNIAJ7XCP76VUVJ454DWCI6GRPSGBUJ63MQC6A, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.575467720 (308h45m21.459421941s) [noise=true , address=185.167.204.206:4055 , piece_id=ECFXHXJRBIYY2CUWU57YQSM5YLZC2VG5ONXWPMDPHRQQYDDFKZVQ, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.575553440 (308h45m21.459507647s) [noise=true , address=185.167.204.205:4033 , piece_id=MACYA7S4S74PCCEMDEHYJBIYBOOGEOZNTKRDCJMMUUTPHCT3XEJA, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.575946366 (308h45m21.459900565s) [noise=true , address=185.167.204.206:4070 , piece_id=HMVIENI2WM2FFJUNX5KHAILROKFJS7HQ23OAC3ROIH6JARXR2OTQ, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:43.576153229 (308h45m21.460107428s) [noise=true , address=185.167.204.206:4056 , piece_id=WK6U5HV5JGHWMFN5U6CTVCWBXL7EQBCQFXZ66HKJW2S2FSIAGADQ, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:44.019796655 (308h45m21.903750855s) [noise=true , address=89.149.201.147:4021 , piece_id=ZUOSA4GJYEMMOR7OUVAS6DY7YXTXSWE2YWTAK65JOEY7AH756LTA, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:44.031375596 (308h45m21.915329808s) [noise=true , address=81.171.14.70:4028 , piece_id=VC5RGA6BSD3DYKQU45W4O7XLZFAIAAXIL4WP37GC3575JGP7PF6A, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:40:44.088039884 (308h45m21.971994084s) [noise=true , address=89.149.201.147:4022 , piece_id=774E4VLGRILSFAYATGVTGOSLPUFCQ3ZOG5IN3AH27H7VXAJO6FJQ, seg_pos={0 0}, upload=271583]: Done uploading piece. err: <nil> Jan 28 12:41:43.355258707 (308h46m21.239212916s) [noise=true , address=89.149.201.147:4019 , piece_id=Q5C7P2T6MZNLEV7PDI7PSZP7U645T5QZ7UCUKRS4F6LGNJYNXA7Q, seg_pos={0 0}, upload=271583]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: context deadline exceeded; context deadline exceeded Jan 28 12:41:43.355493637 (308h46m21.239447844s) [seg_pos={0 0}, upload=271583]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Jan 28 12:41:43.542633652 (308h46m21.426587855s) [upload=271583]: Done uploading segments... Jan 28 12:41:43.542685835 (308h46m21.426640039s) [upload=271583]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 1m0.19000415s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX] duration: 1m0.017018129s trace: https://jaeger.dev.storj.io/trace/71b5b4886c1cf65b FAIL (2026-01-28 12:40:43 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== .. Jan 28 12:39:43.278468925 (308h44m21.162423115s) [noise=true , address=185.167.204.206:4050 , piece_id=6JYC2XTSR4EMPYOXCK33UWEQWX7UBHZPVSIDBWEEHREZBFW4JLTA, seg_pos={0 0}, upload=271571]: Uploading piece... Jan 28 12:39:43.278908063 (308h44m21.162862252s) [noise=true , address=81.171.14.70:4040 , piece_id=XIGXNGABBFUDJZZUUNLGMNAWSDBCMI3426HZ2A3GDPTLCWKSPQ5Q, seg_pos={0 0}, upload=271571]: Uploading piece... Jan 28 12:39:43.279330595 (308h44m21.163284801s) [noise=true , address=81.171.14.70:4042 , piece_id=PLHZMZ3FLYU4KHJSTUEGKBPJJO3Q2VQL3EUOWH65CXWRJ7L23R3Q, seg_pos={0 0}, upload=271571]: Uploading piece... Jan 28 12:39:43.279723143 (308h44m21.163677333s) [noise=true , address=185.167.204.206:4054 , piece_id=PM66NDZZBU4TP3NILC3ZZGN5D5R6UOGZGMYD76GMLEGONTSG6EJQ, seg_pos={0 0}, upload=271571]: Uploading piece... Jan 28 12:39:43.280071216 (308h44m21.164025415s) [noise=true , address=89.149.201.147:4016 , piece_id=AN4POXSJ2XIHBAZDE6GUS4RVEZNKUEGYCZM35AW3DI643JVQKEDQ, seg_pos={0 0}, upload=271571]: Uploading piece... Jan 28 12:39:43.280458760 (308h44m21.164412966s) [noise=true , address=81.171.14.70:4026 , piece_id=R7Y5U2XTDO5G2PXK2KQ6UG4OYDCCBFVDHGFPQOWJY4X2BGE55W5Q, seg_pos={0 0}, upload=271571]: Uploading piece... Jan 28 12:39:43.280870569 (308h44m21.164824774s) [noise=true , address=89.149.201.147:4014 , piece_id=GJICYQWYI4RLOVWXV7RSVHFCROANMCN6QUJRKUTSYQHGQTN3ZDZQ, seg_pos={0 0}, upload=271571]: Uploading piece... Jan 28 12:39:43.281224910 (308h44m21.165179116s) [noise=true , address=81.171.14.70:4041 , piece_id=HQLKIB5OMZFAZYX7XOHZLHLXMX3RP3FROPZZZFMJXI42RJ3GL62Q, seg_pos={0 0}, upload=271571]: Uploading piece... Jan 28 12:39:43.315561999 (308h44m21.199516283s) [noise=true , address=89.149.201.147:4016 , piece_id=AN4POXSJ2XIHBAZDE6GUS4RVEZNKUEGYCZM35AW3DI643JVQKEDQ, seg_pos={0 0}, upload=271571]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: write tcp 139.59.144.22:54638->89.149.201.147:4016: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:39:43.315785202 (308h44m21.199739411s) [noise=true , address=89.149.201.147:4013 , piece_id=A2XIEJUJZIS3DWJG35WQMFUS6LX6LBLWAA6L7MYRJP3B7KBOXTIQ, seg_pos={0 0}, upload=271571]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: write tcp 139.59.144.22:58214->89.149.201.147:4013: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:39:43.319788258 (308h44m21.20374246s) [noise=true , address=89.149.201.147:4010 , piece_id=5EZWVPCGT3VU7COFABWNJ67U4CPRWYNKW6LIL3KQGQEMS4K2LBTQ, seg_pos={0 0}, upload=271571]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:40020->89.149.201.147:4010: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:39:43.366600276 (308h44m21.250554475s) [upload=271571]: Next returned nil segment Jan 28 12:39:43.366618192 (308h44m21.250572389s) [upload=271571]: Waiting for error group managing segments... Jan 28 12:39:43.400787964 (308h44m21.28474217s) [noise=true , address=89.149.201.147:4023 , piece_id=XDT63GZL3TVF6KETOSQ32DPV5QDMRL4VMDV2EQTYHS6TNZF2UTTA, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.402492919 (308h44m21.28644713s) [noise=true , address=81.171.14.70:4026 , piece_id=R7Y5U2XTDO5G2PXK2KQ6UG4OYDCCBFVDHGFPQOWJY4X2BGE55W5Q, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.403240035 (308h44m21.287194235s) [noise=true , address=81.171.14.70:4047 , piece_id=ZNFNMMJDB32DIYUBLVG6PS2RLPFP4MH4QK6VBH25MUZQTPLQUTWQ, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.410521404 (308h44m21.294475616s) [noise=true , address=81.171.14.70:4028 , piece_id=W7KJJ4FB4PFMJLPLOETMQSMSI7DMLCSNA5RSKEP7RTQ7CZGIY7RQ, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.410668785 (308h44m21.294622974s) [noise=true , address=81.171.14.70:4034 , piece_id=XLDKJNXXLBPGQOEYTAZNMV6VKACNDVXPBHCWLQ2RH6C72FZTLQLQ, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.412960756 (308h44m21.296914958s) [noise=true , address=81.171.14.70:4025 , piece_id=6CODLEXKA2BZRTDEGCAYO25RW7BEWYEXH6RT7TGJEABWTHZVFENA, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.419539688 (308h44m21.303493886s) [noise=true , address=185.167.204.206:4054 , piece_id=PM66NDZZBU4TP3NILC3ZZGN5D5R6UOGZGMYD76GMLEGONTSG6EJQ, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.425411439 (308h44m21.309365639s) [noise=true , address=185.167.204.206:4040 , piece_id=R6ZMQG2N2ETYCMLETOWZTBMNRTUNEMFIN65BAFILPILQEDW2U7PA, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.425886144 (308h44m21.309840335s) [noise=true , address=81.171.14.70:4035 , piece_id=F5SR45KK2JCISONKC4TCJFPKTKQA25O66KQO37MD5KZKZDE6C4YA, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.428127528 (308h44m21.312081727s) [noise=true , address=185.167.204.206:4050 , piece_id=6JYC2XTSR4EMPYOXCK33UWEQWX7UBHZPVSIDBWEEHREZBFW4JLTA, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.430928474 (308h44m21.314882683s) [noise=true , address=185.167.204.206:4072 , piece_id=YOEPE7O2BLPN7ED6W4AUYZNLWHWQPOVMTRYABB6XAO3KRDZWMN3Q, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.433854955 (308h44m21.31780916s) [noise=true , address=81.171.14.70:4041 , piece_id=HQLKIB5OMZFAZYX7XOHZLHLXMX3RP3FROPZZZFMJXI42RJ3GL62Q, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.435111756 (308h44m21.319065957s) [noise=true , address=81.171.14.70:4042 , piece_id=PLHZMZ3FLYU4KHJSTUEGKBPJJO3Q2VQL3EUOWH65CXWRJ7L23R3Q, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.444368631 (308h44m21.328322842s) [noise=true , address=81.171.14.70:4040 , piece_id=XIGXNGABBFUDJZZUUNLGMNAWSDBCMI3426HZ2A3GDPTLCWKSPQ5Q, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.459272500 (308h44m21.343226711s) [noise=true , address=185.167.204.206:4055 , piece_id=G4VM5U6Y7NZM3YZ6RJ5WYCZLOLROH2BXKKUJW46ZO74L263LMWUA, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.461184083 (308h44m21.345138283s) [noise=true , address=185.167.204.206:4037 , piece_id=ILDRUYX5DEGRO56AAY4VSB7FIZVHJTTAJTF4X46Q4UI67COPM6DA, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.461289277 (308h44m21.345243466s) [noise=true , address=185.167.204.206:4059 , piece_id=6YPR6H4YAUSZ6P5DRHJ7OTUG46FX5VEL3O4CIR2JOANO5OQ24ECQ, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.466705526 (308h44m21.350659734s) [noise=true , address=185.167.204.206:4068 , piece_id=VKVIJS6FGEOJVRL4C4XHTJNYQK5EEUOPOSKW2ZNTOE7VEEQKMZGA, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.851623857 (308h44m21.735578108s) [noise=true , address=81.171.14.70:4031 , piece_id=RDHRYYSOLDN3MJNBAQO5LC6KBCTQSLDMNGM3Y3UABXFP3E5EV5OA, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.896790414 (308h44m21.780744624s) [noise=true , address=81.171.14.70:4046 , piece_id=HTUUFGHVLULMKTOLDOHTK5F3JGHTVGNSFKOWYIWTGZOXFIPJ5SHQ, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.906016927 (308h44m21.789971139s) [noise=true , address=89.149.201.147:4015 , piece_id=MXZYVFNBL2TWAGAIQI7I32VOKYVJIIIC6COB7IJSCLQ6INPIWG7A, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:39:43.944512293 (308h44m21.828466512s) [noise=true , address=81.171.14.70:4043 , piece_id=ATCDLZDITQEPRCRNRJ5D2CO5SVKHNFJEDAHDFIS2N2JWDMXJW6HA, seg_pos={0 0}, upload=271571]: Done uploading piece. err: <nil> Jan 28 12:40:43.198863656 (308h45m21.082817858s) [noise=true , address=89.149.201.147:4001 , piece_id=ZA6RS7SGEKV5NIK7JRQKZ4IBZNKZVQH57NCZ3XC5LD7KUBK5O5FQ, seg_pos={0 0}, upload=271571]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 139.59.144.22:41590->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:40:43.199196412 (308h45m21.08315062s) [noise=true , address=89.149.201.147:4014 , piece_id=GJICYQWYI4RLOVWXV7RSVHFCROANMCN6QUJRKUTSYQHGQTN3ZDZQ, seg_pos={0 0}, upload=271571]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 139.59.144.22:52332->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:40:43.199367119 (308h45m21.083321321s) [noise=true , address=89.149.201.147:4007 , piece_id=LA3UE34FYKW3SOYRF65XCJURR5K6HTXD5KFBMRJZDCI442S45LKA, seg_pos={0 0}, upload=271571]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 139.59.144.22:43212->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:40:43.199393027 (308h45m21.083347219s) [seg_pos={0 0}, upload=271571]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Jan 28 12:40:43.212672246 (308h45m21.09662645s) [upload=271571]: Done uploading segments... Jan 28 12:40:43.212725842 (308h45m21.09668005s) [upload=271571]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 1m0.017034628s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 9 out of 60 is failed (threshold=3) [...................................................XXXXXXXXX] duration: 1m0.017080771s trace: https://jaeger.dev.storj.io/trace/351bb1e0afcce13f FAIL (2026-01-28 12:39:43 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 18) ======LOGS====== 12:38:43.117135883 (308h43m21.001090086s) [noise=true , address=185.167.204.205:4012 , piece_id=KO2RDI7MF4FNX5MTFIGWI6XI3F3UTW52SC35XIYKXIOU4GDMSC7A, seg_pos={0 0}, upload=271558]: Uploading piece... Jan 28 12:38:43.117438973 (308h43m21.001393182s) [noise=true , address=185.167.204.206:4061 , piece_id=WF4436DNUPRMWA47LSRBB4YLE4TDVYYRILWUF3OASKNQLILYNKVQ, seg_pos={0 0}, upload=271558]: Uploading piece... Jan 28 12:38:43.117785809 (308h43m21.001740011s) [noise=true , address=185.167.204.205:4030 , piece_id=3B5CDERT252ZI2EUY5NWSDFRHTP3CS5FOZKSG5LMZP4N5Q5FJSYQ, seg_pos={0 0}, upload=271558]: Uploading piece... Jan 28 12:38:43.142986025 (308h43m21.026940237s) [noise=true , address=89.149.201.147:4013 , piece_id=2LE54MDP2GCSPB5DRXAVM5NWZRBS36SZD3Q6SVYEVW6QM32OWQOQ, seg_pos={0 0}, upload=271558]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: write tcp 139.59.144.22:43580->89.149.201.147:4013: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:38:43.143335257 (308h43m21.027289463s) [noise=true , address=185.167.204.205:4008 , piece_id=YDP7C3ZDWSPI2WWYDZRKWK5CCNITLWSJE3DL2KDPYJQRNRMINB6A, seg_pos={0 0}, upload=271558]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: write tcp 139.59.144.22:48648->185.167.204.205:4008: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:38:43.143821343 (308h43m21.027775553s) [noise=true , address=89.149.201.147:4008 , piece_id=R2HQUFPUEACA6MIIDNDC5QHANZ7TYK6KM5VNHDFTOCRBSHHWYY2Q, seg_pos={0 0}, upload=271558]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: write tcp 139.59.144.22:53982->89.149.201.147:4008: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:38:43.145769147 (308h43m21.029723353s) [noise=true , address=185.167.204.205:4002 , piece_id=L3JP6FD7OGFGE4LIY35HGQUKRANPBQRBQOGZWZD23LTRIQU4ROIA, seg_pos={0 0}, upload=271558]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 139.59.144.22:57148->185.167.204.205:4002: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:38:43.146556771 (308h43m21.030510978s) [noise=true , address=89.149.201.147:4010 , piece_id=2TSZFE5UHBB5C4F3S4OQAUFJFXKUDPSG7BWRFS4JJQUQJR4RN7OQ, seg_pos={0 0}, upload=271558]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:49656->89.149.201.147:4010: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:38:43.150678071 (308h43m21.034632282s) [noise=true , address=89.149.201.147:4006 , piece_id=XHQ563FRCJ3UJF4SQLUWPVPLPV2X76K4SO3EVC3WWLRNIBQ57R5Q, seg_pos={0 0}, upload=271558]: Done uploading piece. err: ecclient: upload failed (node:12YTf9jvAKd4gVTxTZC6gGLdXC17ygbrqvqoKtmPbtHyc65YjDU, address:89.149.201.147:4006): protocol: write tcp 139.59.144.22:54654->89.149.201.147:4006: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:38:43.151257448 (308h43m21.035211679s) [noise=true , address=185.167.204.205:4021 , piece_id=UTDREOS3FJJKYREWGNVYOZHCB3YZBSDIXLJTP5BJ4QSSZ74REIYQ, seg_pos={0 0}, upload=271558]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:42812->185.167.204.205:4021: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:38:43.153603203 (308h43m21.037557413s) [noise=true , address=185.167.204.205:4006 , piece_id=UQCSWJJTM3FW63K2QKY6XD7XSMIX77SLOACL6WCUCOABAFJMLLFA, seg_pos={0 0}, upload=271558]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: write tcp 139.59.144.22:35566->185.167.204.205:4006: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:38:43.237056234 (308h43m21.121010433s) [upload=271558]: Next returned nil segment Jan 28 12:38:43.237076520 (308h43m21.121030731s) [upload=271558]: Waiting for error group managing segments... Jan 28 12:38:43.258774753 (308h43m21.14272896s) [noise=true , address=81.171.14.70:4033 , piece_id=4IQH2GYWBD576D2DBQ32H5WSVQQIEZZ52L2JS6YXQLCFXXZ6SSFA, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.263423744 (308h43m21.147377943s) [noise=true , address=81.171.14.70:4040 , piece_id=VYSPFMYCQN5IXLYE65Q7K537BECKIGKDJQNSTLLB7FCISC7N2TDA, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.266591591 (308h43m21.150545803s) [noise=true , address=185.167.204.205:4030 , piece_id=3B5CDERT252ZI2EUY5NWSDFRHTP3CS5FOZKSG5LMZP4N5Q5FJSYQ, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.271681322 (308h43m21.155635529s) [noise=true , address=185.167.204.205:4034 , piece_id=TZ5SVYRRUOZYKX3GC25BHCU6TIIJKPHSKXELK5CZFEHWEAQR5WYQ, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.272051490 (308h43m21.156005694s) [noise=true , address=185.167.204.206:4055 , piece_id=RGIKTLC7SIT6WGGSXP4JZ6OWXPDHLXUT6C675Z576R3H25VW5MUQ, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.273061994 (308h43m21.157016201s) [noise=true , address=81.171.14.70:4035 , piece_id=K7PREOJZLSSRZKKZ2IFSAK5WOAJBAEJH2V2SGUBBCCVATIA5APBA, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.273834334 (308h43m21.15778854s) [noise=true , address=185.167.204.205:4025 , piece_id=I6WYAHLQV5IIZBSY6CEDN5PXDDOSPR4T65QIVBZVC4SM5B2HVIZA, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.274251584 (308h43m21.158205793s) [noise=true , address=81.171.14.70:4026 , piece_id=PXYK2M5EH3XRLXIBQBHWENCGVGBFBPAAPZWDYLAV53PJHXJ7IR6A, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.274791439 (308h43m21.15874565s) [noise=true , address=81.171.14.70:4041 , piece_id=ZTCOUCMQV2RLEIJFDXOAZBO5IMVI252EY74LT4SZW7M5IOHHYBUQ, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.276140053 (308h43m21.16009426s) [noise=true , address=185.167.204.205:4028 , piece_id=PWQT75HB35W7KDMMJHGIZUWB53AI7VI23SA4ZUCSABDZMIER2YKA, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.278122248 (308h43m21.162076454s) [noise=true , address=185.167.204.206:4061 , piece_id=WF4436DNUPRMWA47LSRBB4YLE4TDVYYRILWUF3OASKNQLILYNKVQ, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.280533801 (308h43m21.164488008s) [noise=true , address=185.167.204.206:4063 , piece_id=LQX25N77WZRW2VRSDQIFYMW5IE3JDR6RPXW555GF2T3662LUFVPA, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.281240833 (308h43m21.165195039s) [noise=true , address=185.167.204.206:4044 , piece_id=ZY5SLSJYJV36XGNHXB7EYVCOXONBPYL3WNK27DINKHMTIZ22SHRA, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.281743405 (308h43m21.165697612s) [noise=true , address=185.167.204.206:4056 , piece_id=U7VE34RUVU6J7CKXS6QPUVAQCMGWTKO65OHZRPEIQQI4UPJJCO3A, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.282293669 (308h43m21.166247875s) [noise=true , address=185.167.204.205:4029 , piece_id=HS5EK4O2LQOFAEXGDT6IVCIHZNP36OP7A7XAX7KKRV6APHRVSKOQ, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.325877371 (308h43m21.209831574s) [noise=true , address=81.171.14.70:4034 , piece_id=KVBHZBTH3W2DG6JOMGJZ7G5CQQ66WNUABDYQ4NPTYQSKW5FWZPOA, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.329209723 (308h43m21.213163924s) [noise=true , address=81.171.14.70:4025 , piece_id=ZHJD24EX6OVH3PSYHTKEUFKR2DYDDPWFTNEKST2WPKRZQA57SEXQ, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:38:43.797690653 (308h43m21.681644862s) [noise=true , address=81.171.14.70:4029 , piece_id=52VOD2BCEYVMWNK4GAQF7WJP5Q2J2AUCGR5OJ2YQSWVBCM3GA3ZQ, seg_pos={0 0}, upload=271558]: Done uploading piece. err: <nil> Jan 28 12:39:43.047602394 (308h44m20.931556632s) [noise=true , address=89.149.201.147:4002 , piece_id=VPLP7HBB356YNZICK2KFXEN6XT3O7YT6JP6THJ36YT7N23PK4SSQ, seg_pos={0 0}, upload=271558]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 139.59.144.22:40846->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:39:43.048133283 (308h44m20.932087491s) [noise=true , address=185.167.204.205:4012 , piece_id=KO2RDI7MF4FNX5MTFIGWI6XI3F3UTW52SC35XIYKXIOU4GDMSC7A, seg_pos={0 0}, upload=271558]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: read tcp 139.59.144.22:56534->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:39:43.048377849 (308h44m20.932332054s) [seg_pos={0 0}, upload=271558]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil> Jan 28 12:39:43.060744746 (308h44m20.944698956s) [upload=271558]: Done uploading segments... Jan 28 12:39:43.060788635 (308h44m20.944742845s) [upload=271558]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18) Duration: 1m0.017098748s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 8 out of 60 is failed (threshold=3) [....................................................XXXXXXXX] duration: 1m0.040302507s trace: https://jaeger.dev.storj.io/trace/5e0bbabd9319491 FAIL (2026-01-28 12:38:42 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== _id=JUX6DSZZYGSSD23BKAEXFZACI527U335FLXGA5EXNET6RQWTLUZA, seg_pos={0 0}, upload=271541]: Uploading piece... Jan 28 12:37:42.923953171 (308h42m20.807907362s) [noise=true , address=185.167.204.206:4071 , piece_id=RDO6WEZL6RWODFNFDURGKNA53AKBRTIB5MZEEEXMKZ6HRXJ473ZA, seg_pos={0 0}, upload=271541]: Uploading piece... Jan 28 12:37:42.924383095 (308h42m20.808337302s) [noise=true , address=185.167.204.206:4043 , piece_id=PIYIH2MD4T5I2OH4GIFFLZNJHOLUGVBEPNEMHNZZJ56BB5OVXKIA, seg_pos={0 0}, upload=271541]: Uploading piece... Jan 28 12:37:42.924604214 (308h42m20.808558421s) [noise=true , address=89.149.201.147:4013 , piece_id=FA7SU7SOOD4AWPZJZVE5TEKFNDMD6A7BVAMHKY2SZG362GVLSNWA, seg_pos={0 0}, upload=271541]: Uploading piece... Jan 28 12:37:42.927003609 (308h42m20.81095781s) [noise=true , address=89.149.201.147:4023 , piece_id=PF2IKE7IJ72C2775AUKM7R4A5FBOM66RO4GK4Z3IGUVMJC4C5ROQ, seg_pos={0 0}, upload=271541]: Uploading piece... Jan 28 12:37:42.963042003 (308h42m20.846996211s) [noise=true , address=89.149.201.147:4013 , piece_id=FA7SU7SOOD4AWPZJZVE5TEKFNDMD6A7BVAMHKY2SZG362GVLSNWA, seg_pos={0 0}, upload=271541]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: write tcp 139.59.144.22:58064->89.149.201.147:4013: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:37:42.966534680 (308h42m20.850488881s) [noise=true , address=185.167.204.205:4002 , piece_id=R6BLBV3VLRBC474FDDPX5MO7N4EGKFXSXN4IWRR6BG6BJVI4OWTA, seg_pos={0 0}, upload=271541]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:37:42.967775337 (308h42m20.85172955s) [noise=true , address=89.149.201.147:4008 , piece_id=JUX6DSZZYGSSD23BKAEXFZACI527U335FLXGA5EXNET6RQWTLUZA, seg_pos={0 0}, upload=271541]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: rpc: dial tcp 89.149.201.147:4008: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:37:42.968208954 (308h42m20.852163166s) [noise=true , address=89.149.201.147:4011 , piece_id=WOFKQAXTRKLF2YHYYDWKR4XSQPRX6OYPL6ARGQTHD6RL752Q2JSQ, seg_pos={0 0}, upload=271541]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: rpc: dial tcp 89.149.201.147:4011: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:37:42.968292698 (308h42m20.852246925s) [noise=true , address=185.167.204.205:4005 , piece_id=PHLRXU5JPU52RMORFOUTVVMEAZCY5SLSJCQVBBHGB7IKEVOMJ7EA, seg_pos={0 0}, upload=271541]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: rpc: dial tcp 185.167.204.205:4005: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:37:42.971063782 (308h42m20.855017989s) [noise=true , address=89.149.201.147:4010 , piece_id=NH4JMO76M3MVEYWJ4KQTAGKVZUSHFT3KEHTJHXVKAI7VIKI4A4VQ, seg_pos={0 0}, upload=271541]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:51844->89.149.201.147:4010: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:37:43.026380262 (308h42m20.910334453s) [upload=271541]: Next returned nil segment Jan 28 12:37:43.026397979 (308h42m20.910352185s) [upload=271541]: Waiting for error group managing segments... Jan 28 12:37:43.049077123 (308h42m20.933031322s) [noise=true , address=185.167.204.206:4071 , piece_id=RDO6WEZL6RWODFNFDURGKNA53AKBRTIB5MZEEEXMKZ6HRXJ473ZA, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.055228474 (308h42m20.939182683s) [noise=true , address=185.167.204.206:4069 , piece_id=RABBTM7YZIINOAQ4QC7BD5ZKW4TTOMYXSPOI4DKOWA6E23EZ65KA, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.056000151 (308h42m20.939954355s) [noise=true , address=185.167.204.205:4028 , piece_id=Y2UFOOCQGHTTBBVLQEHFZNYOUCBGSPOH3XJXDZOIJGXNCT3OCEMA, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.058356948 (308h42m20.942311149s) [noise=true , address=185.167.204.206:4055 , piece_id=BYFXGTFXFWDIVZIT2EHPCRL3QBWLXI3SQBHNNEN734OX2G62KHMQ, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.060755495 (308h42m20.944709701s) [noise=true , address=185.167.204.205:4033 , piece_id=H7CQ4DKKJ4TNJ5QNRAP5NA4O4QZIXUCZ7YXBZW2RXS6UWLPEYILA, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.064810681 (308h42m20.948764883s) [noise=true , address=81.171.14.70:4033 , piece_id=MSQNNGLWI3VAG2XT4QOMR7VLQOBX5ZY3ENR2XR4SY4I6HZCWMXFQ, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.065733273 (308h42m20.949687476s) [noise=true , address=81.171.14.70:4037 , piece_id=LTAUQOU2YA5LUHIZYRWEEVTE5HTPTV4A3G6BUTK3MSM6FHNC2M3A, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.067356519 (308h42m20.951310725s) [noise=true , address=185.167.204.206:4072 , piece_id=UDB5BJBYSKKMEQCEKD35UIXNFMCUAXRLBWXDDF4CRKVJXHNFNT2Q, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.078011779 (308h42m20.961965985s) [noise=true , address=185.167.204.206:4063 , piece_id=KL3JMCFXEEZFGZIHPHTFPCJQGM4WXV56WD4TBBERPRRMXLYHNZXQ, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.078468453 (308h42m20.962422659s) [noise=true , address=185.167.204.206:4060 , piece_id=7FL5PDEGS22BQB7WZSKIEMZHJE4MFYZTEFD4UUQ5KLBNF4BX7AKQ, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.078848111 (308h42m20.962802313s) [noise=true , address=185.167.204.205:4036 , piece_id=QEENBF3VBSWAHGCU3ABMRO2XNMZ2VR5XYCAG5QJRLGPFUMHDRYNQ, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.082960086 (308h42m20.966914286s) [noise=true , address=81.171.14.70:4026 , piece_id=DDG5SYO4XB3EIVHGCQE4GOUAIDC253OVMOAXZ3Z7HWD2DQFMYQEQ, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.083263349 (308h42m20.967217537s) [noise=true , address=185.167.204.206:4043 , piece_id=PIYIH2MD4T5I2OH4GIFFLZNJHOLUGVBEPNEMHNZZJ56BB5OVXKIA, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.085155478 (308h42m20.969109667s) [noise=true , address=81.171.14.70:4041 , piece_id=AH57LEF2HJN2EA3XKKADMCAFBHHY5BAWQRRR33XNPYVUHBTNFZ7Q, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.087775509 (308h42m20.97172971s) [noise=true , address=89.149.201.147:4022 , piece_id=2NPT6WF5ML5EPK2G6PIE4NZMU6Q222S3N2D5NS7YDEHRNFBU2DRQ, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.106863768 (308h42m20.990817967s) [noise=true , address=81.171.14.70:4029 , piece_id=QE4YO2SBPTMLP2JVX47F2KGNJHACFESY3YMBQ73CLKMZ6GFBM7MA, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.504711908 (308h42m21.388666098s) [noise=true , address=89.149.201.147:4023 , piece_id=PF2IKE7IJ72C2775AUKM7R4A5FBOM66RO4GK4Z3IGUVMJC4C5ROQ, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.566947216 (308h42m21.450901406s) [noise=true , address=81.171.14.70:4032 , piece_id=D2R4W7HYRDDEDEJMHUBFSVGBDHHL4T5SHRCKZ4OLMEVOUT2GUAJQ, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:37:43.588470803 (308h42m21.472425009s) [noise=true , address=81.171.14.70:4044 , piece_id=4KU7SMJQZZOBPXQSYQ4BLCNHJ6IVD7GRJJPXDN74ZHTBG4GZZYGQ, seg_pos={0 0}, upload=271541]: Done uploading piece. err: <nil> Jan 28 12:38:42.866139994 (308h43m20.750094201s) [noise=true , address=89.149.201.147:4003 , piece_id=E3GQSHOWL4Y65BDU4EM5KYMPIW244CEQ5PNVSFJG6ZLOY2ZHOCUQ, seg_pos={0 0}, upload=271541]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: read tcp 139.59.144.22:59574->89.149.201.147:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:38:42.866210916 (308h43m20.75016511s) [noise=true , address=89.149.201.147:4007 , piece_id=MIRVN7QQQ3LXISLS4IFMC4ITIXMNCNROHMGJE6LRTWWYJMBA655Q, seg_pos={0 0}, upload=271541]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 139.59.144.22:37392->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:38:42.866613546 (308h43m20.750567755s) [noise=true , address=89.149.201.147:4005 , piece_id=GS2BLZNRL36OBZTPIA6ZUMP5TXZHOLKHFCRBRBVPRPUSYULRNU4A, seg_pos={0 0}, upload=271541]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 139.59.144.22:37334->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:38:42.866676991 (308h43m20.750631185s) [seg_pos={0 0}, upload=271541]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jan 28 12:38:42.903992711 (308h43m20.78794691s) [upload=271541]: Done uploading segments... Jan 28 12:38:42.904027979 (308h43m20.787982184s) [upload=271541]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 1m0.040319139s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 7 out of 60 is failed (threshold=3) [.....................................................XXXXXXX] duration: 1m0.019226923s trace: https://jaeger.dev.storj.io/trace/104181b5652d7463 FAIL (2026-01-28 12:37:42 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== 8h41m20.626422279s) [noise=true , address=81.171.14.70:4042 , piece_id=DSXJWQNJV6WOP4EFQUQJ7523YRCXVANFWRUBWADC6BXMMTORXPLA, seg_pos={0 0}, upload=271525]: Uploading piece... Jan 28 12:36:42.743926897 (308h41m20.627881096s) [noise=true , address=185.167.204.206:4065 , piece_id=JYWICFGAYPMLURJIKIE3E4O2V27IRYHYW5RJBQOZPHKWWOWZDHQQ, seg_pos={0 0}, upload=271525]: Uploading piece... Jan 28 12:36:42.744919529 (308h41m20.628873738s) [noise=true , address=81.171.14.70:4025 , piece_id=UGSRCXMXL2QZBUQLRA4XEIYE5CGGMFJMS2YQS7Q2Q2WPYLQ7W73Q, seg_pos={0 0}, upload=271525]: Uploading piece... Jan 28 12:36:42.746979282 (308h41m20.630933493s) [noise=true , address=185.167.204.206:4051 , piece_id=T2POPMNA4IOTN36HYOJ6B27IGFLWOX4ZVUXIQI4ILCYKPRE23T2A, seg_pos={0 0}, upload=271525]: Uploading piece... Jan 28 12:36:42.749073408 (308h41m20.633027618s) [noise=true , address=185.167.204.206:4040 , piece_id=4UDGK453YJJHAR3K4ZKFX2GORQTP7H42QXTTMAPVDCJMVNN2JBBA, seg_pos={0 0}, upload=271525]: Uploading piece... Jan 28 12:36:42.749701003 (308h41m20.633655209s) [noise=true , address=81.171.14.70:4044 , piece_id=ACQ2MUB5X4GCR4OUTZIIQUYQCXF2DO2F5QGIQBNNONO24XDN6XQQ, seg_pos={0 0}, upload=271525]: Uploading piece... Jan 28 12:36:42.750038804 (308h41m20.633993014s) [noise=true , address=185.167.204.205:4016 , piece_id=UD4ESULKLIMAGMR6XUBSY5CTREL4PNJ5KOCK5CRXG5QR5ZRBTTCA, seg_pos={0 0}, upload=271525]: Uploading piece... Jan 28 12:36:42.780184313 (308h41m20.664138537s) [noise=true , address=89.149.201.147:4013 , piece_id=DL55LHLGKBPDZX3TVDWL2WLWXMIEKRPADRB3IRQ6WEFU76QC7RDA, seg_pos={0 0}, upload=271525]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: write tcp 139.59.144.22:37336->89.149.201.147:4013: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:36:42.782640995 (308h41m20.666595207s) [noise=true , address=185.167.204.205:4009 , piece_id=7IBGJZDQI7DUYCJ47RE5W72DXFOVAAI6VQVC2PTLGTKNRTFCIWFQ, seg_pos={0 0}, upload=271525]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 139.59.144.22:42192->185.167.204.205:4009: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:36:42.784057238 (308h41m20.668011449s) [noise=true , address=185.167.204.205:4016 , piece_id=UD4ESULKLIMAGMR6XUBSY5CTREL4PNJ5KOCK5CRXG5QR5ZRBTTCA, seg_pos={0 0}, upload=271525]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: write tcp 139.59.144.22:37674->185.167.204.205:4016: write: connection refused; manager closed: conn closed: op Jan 28 12:36:42.792868316 (308h41m20.676822527s) [noise=true , address=89.149.201.147:4015 , piece_id=MSAOY3MNEAD635XAUI3RNJ3Y562K5ABHCE3EX6ZHT5UBIPHNOJKA, seg_pos={0 0}, upload=271525]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: write tcp 139.59.144.22:51080->89.149.201.147:4015: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:36:42.887926332 (308h41m20.771880523s) [upload=271525]: Next returned nil segment Jan 28 12:36:42.887957002 (308h41m20.771911202s) [upload=271525]: Waiting for error group managing segments... Jan 28 12:36:42.917217788 (308h41m20.801171995s) [noise=true , address=81.171.14.70:4036 , piece_id=6DD3XZG3OTGMT75OWJWABZ3SNV6HIWR2UXAW2ATUOLMJH3QOSP2A, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.918132968 (308h41m20.802087168s) [noise=true , address=185.167.204.205:4023 , piece_id=FIKZNDNXFKH4QZZGKZFEFY4EE44AI27UGOHZ3E3NL44QSVML6OCA, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.918228372 (308h41m20.802182574s) [noise=true , address=81.171.14.70:4037 , piece_id=LSX2OVM7VEP5DJ2472HIRBN2FMVKIJUW3YYFL7QIKISGZN2JMCDA, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.921289774 (308h41m20.805243975s) [noise=true , address=185.167.204.205:4022 , piece_id=4S4FDMFUFQUAI6PM3KJKVUROPVLIVL6AR2VL5WDN2WXJHJ2C5X4A, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.921491208 (308h41m20.805445407s) [noise=true , address=81.171.14.70:4044 , piece_id=ACQ2MUB5X4GCR4OUTZIIQUYQCXF2DO2F5QGIQBNNONO24XDN6XQQ, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.922849024 (308h41m20.806803233s) [noise=true , address=81.171.14.70:4046 , piece_id=JQNNPSOCS7JNW6DCF6P5L6IIUBW2BH3QEQEV2CCSGZ7G7JHHNWHQ, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.928425705 (308h41m20.812379896s) [noise=true , address=81.171.14.70:4043 , piece_id=KSFO4BIMMT5DALGJKLG4ABIQIU7HTCYZNIPF525EQOG665V2ZXHA, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.928610862 (308h41m20.812565061s) [noise=true , address=81.171.14.70:4047 , piece_id=2OHTRZYVCG25QK5MMCJ4ELFJNEIPMTHUDHR7INMJVQYAI3DBWUSQ, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.933656221 (308h41m20.81761041s) [noise=true , address=81.171.14.70:4042 , piece_id=DSXJWQNJV6WOP4EFQUQJ7523YRCXVANFWRUBWADC6BXMMTORXPLA, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.946149693 (308h41m20.830103912s) [noise=true , address=185.167.204.206:4059 , piece_id=3SWX6WNYX6H4SI5EHE2GFRTJTWUQFQWKSTPVFPNL3CT36QGPXWKA, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.946189630 (308h41m20.830143836s) [noise=true , address=185.167.204.206:4067 , piece_id=LZOXD5JUQQFQ74QJ2AD5K35NY3KYQ4EEDCQCO4VSPYBTN3YITUGQ, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.946807082 (308h41m20.830761281s) [noise=true , address=185.167.204.206:4070 , piece_id=4B7F7SBEVHIRJQAGGCBNPCA5H5X2XAAN3GDW7EEI42ZI4GI34ZSQ, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.946840474 (308h41m20.830794706s) [noise=true , address=185.167.204.206:4037 , piece_id=XHZXUOSLA7JTZ2JMRK6PHEKIG3FASROBJSRV5EEPRGMBPKFDNYGQ, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.947433598 (308h41m20.831387801s) [noise=true , address=185.167.204.206:4057 , piece_id=A7SFSQQZPYFW3NBSJVWBZWV4FHCJA7E3EHEXT4EOVBWJDHPYPGRQ, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.951742717 (308h41m20.835696922s) [noise=true , address=185.167.204.206:4065 , piece_id=JYWICFGAYPMLURJIKIE3E4O2V27IRYHYW5RJBQOZPHKWWOWZDHQQ, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.952569602 (308h41m20.836523804s) [noise=true , address=185.167.204.206:4051 , piece_id=T2POPMNA4IOTN36HYOJ6B27IGFLWOX4ZVUXIQI4ILCYKPRE23T2A, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.953383515 (308h41m20.837337718s) [noise=true , address=185.167.204.206:4040 , piece_id=4UDGK453YJJHAR3K4ZKFX2GORQTP7H42QXTTMAPVDCJMVNN2JBBA, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:42.971825024 (308h41m20.855779232s) [noise=true , address=81.171.14.70:4039 , piece_id=WEOG3QBSQV27HQ6SSYWVA3DIYKTVKPFGWWWK3D42VBDIEYT4TM3A, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:43.382509889 (308h41m21.266464089s) [noise=true , address=81.171.14.70:4025 , piece_id=UGSRCXMXL2QZBUQLRA4XEIYE5CGGMFJMS2YQS7Q2Q2WPYLQ7W73Q, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:43.394212963 (308h41m21.278167164s) [noise=true , address=81.171.14.70:4031 , piece_id=JKXOUWPVAQF4RO2ETPENGXAT4SYECEVSKFH3LD24LLVHDNXTX25Q, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:36:43.432437281 (308h41m21.316391489s) [noise=true , address=81.171.14.70:4034 , piece_id=MJ5GANDQJ6UCMLC7IUEWXO3MAY6CRIOLFJILQKYSKWNMQ4REDKUQ, seg_pos={0 0}, upload=271525]: Done uploading piece. err: <nil> Jan 28 12:37:05.362661800 (308h41m43.24661601s) [noise=true , address=185.167.204.205:4006 , piece_id=W4SAGHEZ2INVKIIV4ZNGRZMV7BALSBD6CUP4QEXEXODU7JZVJPFA, seg_pos={0 0}, upload=271525]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: read tcp 139.59.144.22:51580->185.167.204.205:4006: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:37:42.698719697 (308h42m20.582673909s) [noise=true , address=89.149.201.147:4001 , piece_id=GHGJIN6NKOYQQDCUNPNZN63TH53ZBA3TESIXAUPH4MEGE3ICKE3Q, seg_pos={0 0}, upload=271525]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 139.59.144.22:48374->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:37:42.699077836 (308h42m20.583032049s) [noise=true , address=89.149.201.147:4019 , piece_id=4G6RMRCCJTQXIOZF5KX4PNDLSWUNJ4GXHGRF3AHWUQMV3G4VQDDQ, seg_pos={0 0}, upload=271525]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 139.59.144.22:59768->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:37:42.699123011 (308h42m20.583077213s) [seg_pos={0 0}, upload=271525]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Jan 28 12:37:42.714340906 (308h42m20.598295116s) [upload=271525]: Done uploading segments... Jan 28 12:37:42.714385379 (308h42m20.598339585s) [upload=271525]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 1m0.019245872s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 6 out of 60 is failed (threshold=3) [......................................................XXXXXX] duration: 1m0.021011483s trace: https://jaeger.dev.storj.io/trace/24586bb25621c97a FAIL (2026-01-28 12:36:42 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 1.147:4019 , piece_id=UGAC2LUI2Z4QLDWOPAC2OZC3TC4KEJTZCBRCMU64PNHHILDQKXPA, seg_pos={0 0}, upload=271511]: Uploading piece... Jan 28 12:35:42.605398101 (308h40m20.489352311s) [noise=true , address=81.171.14.70:4038 , piece_id=EEL45GIWD6HI2YMR5CJHRCW56BBRONLATCL7AL6H6REPVSSUX5PA, seg_pos={0 0}, upload=271511]: Uploading piece... Jan 28 12:35:42.606011656 (308h40m20.489965862s) [noise=true , address=81.171.14.70:4042 , piece_id=SQI7TW6RVROBOTFTBSMCB3JEPVJEQX5I5LCAZCQLCKXV335QX2EQ, seg_pos={0 0}, upload=271511]: Uploading piece... Jan 28 12:35:42.606721830 (308h40m20.490676034s) [noise=true , address=185.167.204.206:4049 , piece_id=D6EMDBOKLBOLGBFBFIBL4KEEVPV7MMYDWFZ5VAMOTTKPLXCYLNIQ, seg_pos={0 0}, upload=271511]: Uploading piece... Jan 28 12:35:42.607349515 (308h40m20.491303718s) [noise=true , address=185.167.204.205:4003 , piece_id=BRMHWYZPCZGVCBYIPUAXWM7K55MVUKD5NRPPRHTXBEKZDDTNT4TQ, seg_pos={0 0}, upload=271511]: Uploading piece... Jan 28 12:35:42.607470616 (308h40m20.491424819s) [noise=true , address=185.167.204.206:4040 , piece_id=4NGH6OXG3OHEE5YPDNLOFZZXGSCO22J5O4EJJ5DYVFR2RSGONF2A, seg_pos={0 0}, upload=271511]: Uploading piece... Jan 28 12:35:42.642974069 (308h40m20.526928293s) [noise=true , address=89.149.201.147:4016 , piece_id=Y6PVJSDM5V6PJOOZC2QRXLCMULD6F4XXI4OLHFGZWUPC3EXKEE6A, seg_pos={0 0}, upload=271511]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: write tcp 139.59.144.22:55768->89.149.201.147:4016: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:35:42.644426489 (308h40m20.528380697s) [noise=true , address=89.149.201.147:4010 , piece_id=IH4NZAPB6GZECMP2ZP75OHWETQGMB4CZD2WOEXTDRAZ6PKOJRUVQ, seg_pos={0 0}, upload=271511]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: rpc: dial tcp 89.149.201.147:4010: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:35:42.704635749 (308h40m20.588589957s) [upload=271511]: Next returned nil segment Jan 28 12:35:42.704655573 (308h40m20.588609783s) [upload=271511]: Waiting for error group managing segments... Jan 28 12:35:42.733440461 (308h40m20.61739465s) [noise=true , address=81.171.14.70:4045 , piece_id=GXT7VVRZ735PR4ZRFLUWLAX6VEGIFDANQ6DM3GZN7OTWDVBGEXTQ, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.738716209 (308h40m20.622670423s) [noise=true , address=81.171.14.70:4038 , piece_id=EEL45GIWD6HI2YMR5CJHRCW56BBRONLATCL7AL6H6REPVSSUX5PA, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.742340612 (308h40m20.626294811s) [noise=true , address=81.171.14.70:4030 , piece_id=VOQHJCU7TYOLMML5AV2YX2NPXZHALO2GDOMDT6RKRDLTPQ24NO3Q, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.746664666 (308h40m20.630618866s) [noise=true , address=81.171.14.70:4042 , piece_id=SQI7TW6RVROBOTFTBSMCB3JEPVJEQX5I5LCAZCQLCKXV335QX2EQ, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.746865497 (308h40m20.630819708s) [noise=true , address=185.167.204.206:4043 , piece_id=6Y6L7QREIPSQLZFCCSY2UZNKDUQB4IRLD6MMWQ747OCQM33C77CQ, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.751428049 (308h40m20.635382258s) [noise=true , address=81.171.14.70:4032 , piece_id=2LZWH262AUTVA5M5PPMOGHXYJ2GASEXVT7YXQH3ILQQPVZZRGW5Q, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.751543054 (308h40m20.635497254s) [noise=true , address=81.171.14.70:4027 , piece_id=PZ43QRRPHOI7UAJ6GUD32MCOO2PXMFKAA5VFLSXUQXN63N6YJNIA, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.752062233 (308h40m20.636016434s) [noise=true , address=81.171.14.70:4040 , piece_id=PT44AYTUXMBFF7W6HPLKQTLITVFZVTAUEWTSPT2D74XY4XTOWSSA, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.753734866 (308h40m20.637689073s) [noise=true , address=81.171.14.70:4044 , piece_id=DARPGKE5R3OGEO4AOBKLK6UZXXHO4XDMLVGU72WJMNF7R6IOAUOA, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.755566600 (308h40m20.639520814s) [noise=true , address=185.167.204.206:4041 , piece_id=TYPVR6Y7I5VJXJYUXW22X6VKMODSFROSREIS74TUPJOPPDQNAZQQ, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.759091649 (308h40m20.643045856s) [noise=true , address=185.167.204.205:4034 , piece_id=XUBEHKBYJTIJ5XYIV5ZAVJ3OAXP3ZFTHWS4NDTH4CUHZTEWCDTLQ, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.762880197 (308h40m20.646834423s) [noise=true , address=185.167.204.206:4049 , piece_id=D6EMDBOKLBOLGBFBFIBL4KEEVPV7MMYDWFZ5VAMOTTKPLXCYLNIQ, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.765519424 (308h40m20.649473676s) [noise=true , address=81.171.14.70:4034 , piece_id=HPQKXA65QSTDNQW5P4QRKCUVZEM4IUMIP6ZHTQM3RBO4EN25VK6Q, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.772547936 (308h40m20.656502148s) [noise=true , address=81.171.14.70:4043 , piece_id=ZQR5AWNJ32LL6WLDOIEGVNM7XOHTF3M3FGBZDWGWFRUUI6MP6GWA, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.790947040 (308h40m20.674901251s) [noise=true , address=185.167.204.205:4025 , piece_id=N2ETKKTD5MSDRNQZ2ZEUV5T2JYSPTG55DXYRJGUSTZXNDQTCMK5Q, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.797643625 (308h40m20.681597831s) [noise=true , address=81.171.14.70:4046 , piece_id=HEGKVXSRTQADUACUJLNZQ2B33X5XO4KIPGCTEU3KFXMJOM62SLJQ, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.797800996 (308h40m20.681755205s) [noise=true , address=185.167.204.206:4040 , piece_id=4NGH6OXG3OHEE5YPDNLOFZZXGSCO22J5O4EJJ5DYVFR2RSGONF2A, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.799654275 (308h40m20.683608484s) [noise=true , address=81.171.14.70:4039 , piece_id=W4JYM56SJDXGCRMYH22VM3K6SRGQOLCKAIHZJHWSRAUJ2QCGO6OQ, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:42.803067351 (308h40m20.687021562s) [noise=true , address=81.171.14.70:4029 , piece_id=IJG7SJ5BKJYN4NZXXP5WXF2KN55CQFQZNHOQZCIVTW76ECUX4BPA, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:35:43.252313712 (308h40m21.136267901s) [noise=true , address=81.171.14.70:4036 , piece_id=LVAC6QGF4YBOJUSCXASBHB4KV3QIPMX4HGE2XOMHPPXSN34E4KUQ, seg_pos={0 0}, upload=271511]: Done uploading piece. err: <nil> Jan 28 12:36:42.542704097 (308h41m20.426658306s) [noise=true , address=185.167.204.205:4003 , piece_id=BRMHWYZPCZGVCBYIPUAXWM7K55MVUKD5NRPPRHTXBEKZDDTNT4TQ, seg_pos={0 0}, upload=271511]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: read tcp 139.59.144.22:59058->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:36:42.542758378 (308h41m20.426712587s) [noise=true , address=89.149.201.147:4017 , piece_id=R6RMI7RX6DCODZXERYE7GDMTJWJ2ZSLRBXAMJNPES76V6X7C2JGQ, seg_pos={0 0}, upload=271511]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 139.59.144.22:52962->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:36:42.542984982 (308h41m20.426939181s) [noise=true , address=89.149.201.147:4005 , piece_id=L4CHJ3LZHRBHNYTLIOHA4UHGH3CP4QTIAOVZGB3WHP7X4KYZDRPQ, seg_pos={0 0}, upload=271511]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 139.59.144.22:46284->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:36:42.543029610 (308h41m20.426983815s) [noise=true , address=185.167.204.205:4011 , piece_id=253CPCKUNDFF7INKFA2M6IAUVJI2AVABYOJSPJBR3Y4C4MMY7DYQ, seg_pos={0 0}, upload=271511]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: read tcp 139.59.144.22:45912->185.167.204.205:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:36:42.543247852 (308h41m20.427202054s) [noise=true , address=185.167.204.205:4004 , piece_id=ZXLAL7NCK2JVSTAOZJNNP7FU235N4JG5E7LDBNFGSJAEL6YNCY6A, seg_pos={0 0}, upload=271511]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 139.59.144.22:52682->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:36:42.543542740 (308h41m20.427496946s) [noise=true , address=89.149.201.147:4019 , piece_id=UGAC2LUI2Z4QLDWOPAC2OZC3TC4KEJTZCBRCMU64PNHHILDQKXPA, seg_pos={0 0}, upload=271511]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 139.59.144.22:50794->89.149.201.147:4019: use of closed network connection; context deadline exceeded Jan 28 12:36:42.543581406 (308h41m20.427535599s) [seg_pos={0 0}, upload=271511]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Jan 28 12:36:42.560402177 (308h41m20.444356378s) [upload=271511]: Done uploading segments... Jan 28 12:36:42.560442202 (308h41m20.444396403s) [upload=271511]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 1m0.021052144s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration: 1m0.019699312s trace: https://jaeger.dev.storj.io/trace/67d7e8f5aae4b5ea FAIL (2026-01-28 12:35:29 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== 0468 (308h39m7.533984677s) [noise=true , address=185.167.204.206:4050 , piece_id=IG74U5HYJ3UF5PCPXL257ZTCOG7FRLTNMC3UZIQWF4N5NH743DOA, seg_pos={0 0}, upload=271491]: Uploading piece... Jan 28 12:34:29.650841460 (308h39m7.534795668s) [noise=true , address=81.171.14.70:4044 , piece_id=JNF4KYA7J4LIOOZEIAVAVGORR2YPRQ4VR4YNHFCMUCZRXNC465TQ, seg_pos={0 0}, upload=271491]: Uploading piece... Jan 28 12:34:29.651745352 (308h39m7.535699558s) [noise=true , address=185.167.204.206:4056 , piece_id=34ENF56Z77EE46D7WAZELJOPQVNICOETMDLHEW3SEPGG3OOR6FXA, seg_pos={0 0}, upload=271491]: Uploading piece... Jan 28 12:34:29.652790904 (308h39m7.536745114s) [noise=true , address=89.149.201.147:4022 , piece_id=3CQZGQVJYSTWC7JMLAOAHK3536BBMFRKPCDY3AVQVONQENJZ6XRQ, seg_pos={0 0}, upload=271491]: Uploading piece... Jan 28 12:34:29.653586075 (308h39m7.537540286s) [noise=true , address=185.167.204.206:4059 , piece_id=I6JYZ47QHLX3RG3QUYMBGF4GYMCBH4IT2HZE6YNAP57I2LTEVWDA, seg_pos={0 0}, upload=271491]: Uploading piece... Jan 28 12:34:29.654427663 (308h39m7.538381871s) [noise=true , address=185.167.204.205:4007 , piece_id=OS6QH6DSONCG5W7OWEMIUQRO4R4BOAYUFEM7JRWVLIF7QGTRWD7Q, seg_pos={0 0}, upload=271491]: Uploading piece... Jan 28 12:34:29.655114222 (308h39m7.539068427s) [noise=true , address=185.167.204.205:4025 , piece_id=CKWS2FBMYJMTDNFIQJM3CIROUIGT5U3UDN4PNH6TEPZL244I7KOQ, seg_pos={0 0}, upload=271491]: Uploading piece... Jan 28 12:34:29.692740885 (308h39m7.576695097s) [noise=true , address=185.167.204.205:4008 , piece_id=A7JPN4ES6S5V22EXCVW45KTNG45DTHU6BBO3L2K4JFG2QNEL3BSQ, seg_pos={0 0}, upload=271491]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: write tcp 139.59.144.22:55080->185.167.204.205:4008: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:34:29.693855936 (308h39m7.577810147s) [noise=true , address=185.167.204.205:4007 , piece_id=OS6QH6DSONCG5W7OWEMIUQRO4R4BOAYUFEM7JRWVLIF7QGTRWD7Q, seg_pos={0 0}, upload=271491]: Done uploading piece. err: ecclient: upload failed (node:12m7e6EGQBC1wvbRQ5uwG8wuHbgZeyXPdj5XDMi1kgo5woPgXR, address:185.167.204.205:4007): protocol: write tcp 139.59.144.22:38080->185.167.204.205:4007: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:34:29.700803576 (308h39m7.584757788s) [noise=true , address=89.149.201.147:4013 , piece_id=ACIUVZGAGC23O4U2LAV27LYAZIEFNZ4ZAN5IMQWUMNLBE2YCVM7Q, seg_pos={0 0}, upload=271491]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: write tcp 139.59.144.22:39762->89.149.201.147:4013: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:34:29.706497557 (308h39m7.590451766s) [noise=true , address=185.167.204.205:4009 , piece_id=YVAHFABF2N2K2MJ72MHPOWZLKUDGEECCHKLPCFJNFDACFIF4RRTQ, seg_pos={0 0}, upload=271491]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 139.59.144.22:43786->185.167.204.205:4009: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:34:29.740464483 (308h39m7.624418673s) [upload=271491]: Next returned nil segment Jan 28 12:34:29.740482043 (308h39m7.624436251s) [upload=271491]: Waiting for error group managing segments... Jan 28 12:34:29.768946082 (308h39m7.652900268s) [noise=true , address=81.171.14.70:4047 , piece_id=XA3YYK47YGUYUZ6UWEYFZNKOOQSYKD67CQEJEOL4N54BF3FP3VYA, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.770931497 (308h39m7.654885705s) [noise=true , address=185.167.204.206:4057 , piece_id=2SDIMBILB63HQKHNKIHQRUS46HMMYOK2WWT7XU6Z6M2XX65UZ52Q, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.773635449 (308h39m7.657589652s) [noise=true , address=185.167.204.205:4030 , piece_id=DWABZKW3KZE74FC7UWT7FQSRXZIVRTMORS5AOQA6LURE4DJKWCNA, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.776366018 (308h39m7.66032023s) [noise=true , address=185.167.204.206:4062 , piece_id=NYWOS26Y4SJVHOKPJN4IZIHQDG7G6VXGGGIIDCUTG67KOHHBUR2A, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.778792707 (308h39m7.662746917s) [noise=true , address=185.167.204.206:4055 , piece_id=NIJAECLHOX54IFPHLOQLCPVTANW6B5MI2R5FS7K5P4KB3ZFTABIQ, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.779057065 (308h39m7.663011265s) [noise=true , address=185.167.204.206:4056 , piece_id=34ENF56Z77EE46D7WAZELJOPQVNICOETMDLHEW3SEPGG3OOR6FXA, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.784851926 (308h39m7.66880613s) [noise=true , address=81.171.14.70:4026 , piece_id=AEMYTRKCFLWFFHRESEJ4MNEVGL3MIOKSNLJVTSEBUMBXL46QBX2Q, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.798188958 (308h39m7.682143163s) [noise=true , address=185.167.204.206:4045 , piece_id=HWTPIG3BGEPSJSO36UKVMLJ77CA5APC3ZGTCYJ6GEGMF2CHTO22A, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.800867418 (308h39m7.684821645s) [noise=true , address=185.167.204.205:4032 , piece_id=QB7SQY3WU33CYC3JQZNOHLJMZ4QIVBGXLMJGK2JD6PBFVADG6E5Q, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.802536565 (308h39m7.686490774s) [noise=true , address=89.149.201.147:4022 , piece_id=3CQZGQVJYSTWC7JMLAOAHK3536BBMFRKPCDY3AVQVONQENJZ6XRQ, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.803192391 (308h39m7.687146602s) [noise=true , address=185.167.204.206:4038 , piece_id=Y7XFSUSSSRKSGPWUUM3FIZWDIDS4SXFWUJPH2U566HMCWHGM4ARQ, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.806485710 (308h39m7.690439918s) [noise=true , address=185.167.204.206:4070 , piece_id=WI54636FNHCOUM3M6QE6CZAGYZCVHQ27X4GWO5RVQH4S4KAEXCRQ, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.807636338 (308h39m7.691590529s) [noise=true , address=185.167.204.205:4028 , piece_id=LO2HQAICBN66KDVK2PSV77UB7F6PTP2Z6HC3EH7L6FGCV53M3FFQ, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.808381923 (308h39m7.692336117s) [noise=true , address=185.167.204.206:4051 , piece_id=ET437ADSRJX2TT77HMNSZZ6RZGG7CE2XQCHFBFV4KI5IUO4YR3ZA, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.809018811 (308h39m7.692973011s) [noise=true , address=185.167.204.206:4058 , piece_id=GT4FM56V4DDGROPCEADY4BQZ4L5C2PR5YFU3BI3U5JOFR22W3SBA, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.812373087 (308h39m7.696327276s) [noise=true , address=185.167.204.206:4050 , piece_id=IG74U5HYJ3UF5PCPXL257ZTCOG7FRLTNMC3UZIQWF4N5NH743DOA, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.812949626 (308h39m7.696903815s) [noise=true , address=185.167.204.206:4059 , piece_id=I6JYZ47QHLX3RG3QUYMBGF4GYMCBH4IT2HZE6YNAP57I2LTEVWDA, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.814159451 (308h39m7.698113655s) [noise=true , address=185.167.204.205:4025 , piece_id=CKWS2FBMYJMTDNFIQJM3CIROUIGT5U3UDN4PNH6TEPZL244I7KOQ, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:29.823868470 (308h39m7.707822669s) [noise=true , address=81.171.14.70:4044 , piece_id=JNF4KYA7J4LIOOZEIAVAVGORR2YPRQ4VR4YNHFCMUCZRXNC465TQ, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:30.236904678 (308h39m8.12085889s) [noise=true , address=89.149.201.147:4023 , piece_id=APPNGQ7IL24ACNZ4CKX3UVCM5CKHEHWKDOXSBGZ4ZAXBSMORL3VA, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:34:30.261721700 (308h39m8.145675913s) [noise=true , address=81.171.14.70:4028 , piece_id=ZRLK3UJ3XNWZQQT5OV2TGOPPLAESJ7WB27RY4IZKCVNPP2RJXGKA, seg_pos={0 0}, upload=271491]: Done uploading piece. err: <nil> Jan 28 12:35:29.588689511 (308h40m7.472643721s) [noise=true , address=89.149.201.147:4014 , piece_id=YHZNYELCMRKNLEALKZ5Z674KP5UAAD6RVSJFVLMJS7U5H42ZRIWQ, seg_pos={0 0}, upload=271491]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 139.59.144.22:39122->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:35:29.589019558 (308h40m7.472973769s) [noise=true , address=185.167.204.205:4011 , piece_id=DZA7UYMXBS5QWE6EHVWOBYT26ZFH4U4GILZB6UEPJVEKUCDAN4IQ, seg_pos={0 0}, upload=271491]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: read tcp 139.59.144.22:49382->185.167.204.205:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:35:29.589614611 (308h40m7.473568825s) [noise=true , address=89.149.201.147:4019 , piece_id=EI5RWRZF6IDG3JPNHHMXGSE7DVZPUQ26AGYHKIJCH63UNA46UMQQ, seg_pos={0 0}, upload=271491]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 139.59.144.22:42378->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:35:29.589669536 (308h40m7.473623739s) [seg_pos={0 0}, upload=271491]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Jan 28 12:35:29.605182129 (308h40m7.48913633s) [upload=271491]: Done uploading segments... Jan 28 12:35:29.605218613 (308h40m7.489172816s) [upload=271491]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 1m0.019725411s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [........................................................XXXX] duration: 1m0.021795129s trace: https://jaeger.dev.storj.io/trace/7d8ba1baa5fb1514 FAIL (2026-01-28 12:34:15 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== _pos={0 0}, upload=271475]: Uploading piece... Jan 28 12:33:15.478844575 (308h37m53.362798785s) [noise=true , address=81.171.14.70:4028 , piece_id=B76OZIJJBBCHP6BDGBQR2HAEUQF4EMKBTT4SVBBWUERDAOW6GWOA, seg_pos={0 0}, upload=271475]: Uploading piece... Jan 28 12:33:15.479415828 (308h37m53.363370034s) [noise=true , address=89.149.201.147:4007 , piece_id=II5IYQG33QEPBKQSPKTRDZE7AEZQY2GUY3CIU4G4QVXLRS44F4OQ, seg_pos={0 0}, upload=271475]: Uploading piece... Jan 28 12:33:15.479882033 (308h37m53.363836234s) [noise=true , address=185.167.204.206:4057 , piece_id=NOOIP62KO67233CZPU2OTFAL5KWFNLWIFZLAR2YEZOFFMIR24RMA, seg_pos={0 0}, upload=271475]: Uploading piece... Jan 28 12:33:15.480533811 (308h37m53.364488015s) [noise=true , address=185.167.204.205:4024 , piece_id=B2LP73KULBEFH7TX7XH5LMV5LK7ONROYQGRMFZOY77GBX22PZPEA, seg_pos={0 0}, upload=271475]: Uploading piece... Jan 28 12:33:15.516801405 (308h37m53.400755596s) [noise=true , address=185.167.204.205:4008 , piece_id=3CTEXXTDCVQQ43NBNQWPFNBZYHTV7OV3PEHBS6NLEUSU6CZCOF2A, seg_pos={0 0}, upload=271475]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: write tcp 139.59.144.22:55722->185.167.204.205:4008: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:33:15.517442473 (308h37m53.401396674s) [noise=true , address=185.167.204.205:4015 , piece_id=2U2UTLWWRHFFGZH2ECNUL2JQQMOTYAZCXYPOQSC4RJRI2J3H7OFA, seg_pos={0 0}, upload=271475]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: write tcp 139.59.144.22:55154->185.167.204.205:4015: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:33:15.517648815 (308h37m53.401603017s) [noise=true , address=89.149.201.147:4010 , piece_id=2OYFQGSDS5MB3YZRWTTCPMETCEFLJCJI6PJESIVJCZ7H735RFXBA, seg_pos={0 0}, upload=271475]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: write tcp 139.59.144.22:59348->89.149.201.147:4010: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:33:15.517692948 (308h37m53.401647151s) [noise=true , address=185.167.204.205:4016 , piece_id=A56XUC5RMIQ46U5ZMVAJFK2MWVKJZW5QLZUS5KAFVDZTSR5EWTBA, seg_pos={0 0}, upload=271475]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: write tcp 139.59.144.22:34032->185.167.204.205:4016: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:33:15.520933310 (308h37m53.404887518s) [noise=true , address=185.167.204.205:4020 , piece_id=FNM7V6ROFM74WOCNM6DA5KNOUWNNCZKIMCWWNP6VCDNMHFFVHAEQ, seg_pos={0 0}, upload=271475]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 139.59.144.22:51256->185.167.204.205:4020: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:33:15.521469039 (308h37m53.405423238s) [noise=true , address=185.167.204.205:4018 , piece_id=GBQTBNUARBFH4ZKALSNC3WV6BRHXKOZIJNGSEKQ2MH5RMZUVYABA, seg_pos={0 0}, upload=271475]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:57944->185.167.204.205:4018: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:33:15.527144950 (308h37m53.411099158s) [noise=true , address=185.167.204.205:4007 , piece_id=PERW3ALPGFICHMPJXL3HDCPGSXEZJKRZLYJ3XR4NFT2SW67VTEXA, seg_pos={0 0}, upload=271475]: Done uploading piece. err: ecclient: upload failed (node:12m7e6EGQBC1wvbRQ5uwG8wuHbgZeyXPdj5XDMi1kgo5woPgXR, address:185.167.204.205:4007): protocol: write tcp 139.59.144.22:36880->185.167.204.205:4007: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:33:15.537736721 (308h37m53.421690926s) [noise=true , address=185.167.204.205:4013 , piece_id=JBYBHJXVF6OPE37PIMGNQBEQOPNBU2MGBW5IZAY4QAPSAIAJ2IBQ, seg_pos={0 0}, upload=271475]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:36444->185.167.204.205:4013: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:33:15.577018041 (308h37m53.460972231s) [upload=271475]: Next returned nil segment Jan 28 12:33:15.577032524 (308h37m53.460986723s) [upload=271475]: Waiting for error group managing segments... Jan 28 12:33:15.604094839 (308h37m53.488049039s) [noise=true , address=185.167.204.206:4037 , piece_id=CXMWOAWOWMIE2FBUCN3FVNAVGWT5AMQAV4AZTYQUFL6LNRFYIFYA, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.604929796 (308h37m53.488884005s) [noise=true , address=185.167.204.206:4038 , piece_id=SW5KUB25PGQ77DHSPML6DRIO2CDHSOUPDW4733B44MBPRW6FHEGA, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.604976434 (308h37m53.488930636s) [noise=true , address=185.167.204.206:4062 , piece_id=4KZGEZA76Q5SB56XC2JI3HWPVEDXPIRULHDOL6PJONSMHFUBPBBQ, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.605362834 (308h37m53.489317033s) [noise=true , address=185.167.204.205:4023 , piece_id=HMUAPU75YDFHDUBUTBHLHKCNXV4RK7MH2ZCX6KOOL4LBJVD6Z7QA, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.605858188 (308h37m53.489812387s) [noise=true , address=185.167.204.206:4050 , piece_id=BK6NJWTN7KSHQYQNAM3UBIPN2UAFXJAHRGCYJALQRK4MV7VC5ETA, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.606774647 (308h37m53.490728845s) [noise=true , address=185.167.204.206:4051 , piece_id=SPGA6AU6BXZ7RYARK5TNN5ZEOZ2CE4PEHUC64AXM24CZOXBCON7Q, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.606837549 (308h37m53.490791754s) [noise=true , address=185.167.204.205:4033 , piece_id=2XGAY3ONNTZREQ6KPOW4M5MNT7HBRSRI7EVNLNDIS3DB6PUB3YUQ, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.607336856 (308h37m53.491291042s) [noise=true , address=185.167.204.206:4057 , piece_id=NOOIP62KO67233CZPU2OTFAL5KWFNLWIFZLAR2YEZOFFMIR24RMA, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.609094964 (308h37m53.493049158s) [noise=true , address=185.167.204.206:4058 , piece_id=PWGZ5LPCDVUQQ3FIVWGS22EPVPLJJBAVCQW5WJU546VPJLFUTBAQ, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.609317345 (308h37m53.493271547s) [noise=true , address=185.167.204.205:4024 , piece_id=B2LP73KULBEFH7TX7XH5LMV5LK7ONROYQGRMFZOY77GBX22PZPEA, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.612485421 (308h37m53.49643961s) [noise=true , address=81.171.14.70:4028 , piece_id=B76OZIJJBBCHP6BDGBQR2HAEUQF4EMKBTT4SVBBWUERDAOW6GWOA, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.623717318 (308h37m53.507671529s) [noise=true , address=185.167.204.205:4028 , piece_id=WRJ6FVALB327BBVXRD7DDYSQ3P66VBL5CZ6JRIOFU4KSFMWNMK6A, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.625401342 (308h37m53.509355541s) [noise=true , address=185.167.204.206:4055 , piece_id=OWLG7Q3C73RVJT7A42XKXNJ7HGBV6WNVLHPNMJZC6DCFCL3G5T4A, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.627466473 (308h37m53.511420673s) [noise=true , address=81.171.14.70:4047 , piece_id=IQRIRLJYGMUUFYXY7R3HP2MIZRXRY3CO75XSAD55J7ZSMP3D6P3A, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.642537677 (308h37m53.526491889s) [noise=true , address=81.171.14.70:4044 , piece_id=XQTWNYUDH6V6YYTMHKGRFEOOED2N2US47DVCAI63VO7NSHN6ZFZQ, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.654135853 (308h37m53.538090054s) [noise=true , address=81.171.14.70:4040 , piece_id=VAMVCAS2XXGKXTWOQ6KYNBHAE4D3RB5QTKTNZ4M6EWPAWMA4YNDA, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.665287767 (308h37m53.549241968s) [noise=true , address=185.167.204.205:4034 , piece_id=JCPGFDXKXPBIXJNWS2JDYC6WV5MTKWYR7LIKERWYJBQXGFA5K7RQ, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:15.666404483 (308h37m53.550358686s) [noise=true , address=81.171.14.70:4037 , piece_id=N6MNNJZJOK4LXDNCCIGR6XL6GTBHJ4G3YEN2GUKQJVP6VYS7OPLA, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:33:16.134920477 (308h37m54.018874683s) [noise=true , address=81.171.14.70:4043 , piece_id=ZTGGX2TOYEFZHUE6Y7M7IJDBQI7VDWHIEQX74MPBGI22RYXVKN7Q, seg_pos={0 0}, upload=271475]: Done uploading piece. err: <nil> Jan 28 12:34:15.420332623 (308h38m53.304286835s) [noise=true , address=89.149.201.147:4007 , piece_id=II5IYQG33QEPBKQSPKTRDZE7AEZQY2GUY3CIU4G4QVXLRS44F4OQ, seg_pos={0 0}, upload=271475]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 139.59.144.22:44294->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:34:15.420391194 (308h38m53.304345397s) [seg_pos={0 0}, upload=271475]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jan 28 12:34:15.438421535 (308h38m53.322375739s) [upload=271475]: Done uploading segments... Jan 28 12:34:15.438484385 (308h38m53.322438585s) [upload=271475]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 1m0.021811456s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 1m0.020342868s trace: https://jaeger.dev.storj.io/trace/2101ec0c0f835b02 FAIL (2026-01-28 12:33:14 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 14) ======LOGS====== nection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:32:14.629506099 (308h36m52.513460307s) [noise=true , address=185.167.204.205:4018 , piece_id=VMRJVZXTBKKB5CJ6AWNH7A67UODY72GA77C2H5HXDJPRPPCBA77Q, seg_pos={0 0}, upload=271458]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:34748->185.167.204.205:4018: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:32:14.630814006 (308h36m52.514768216s) [noise=true , address=89.149.201.147:4013 , piece_id=35XXEUT7RMADHRZMKYMFTIWHGD7YISUTKUWWEPIO3EDJKET3PKQQ, seg_pos={0 0}, upload=271458]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: write tcp 139.59.144.22:41726->89.149.201.147:4013: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:32:14.632391315 (308h36m52.516345519s) [noise=true , address=185.167.204.205:4013 , piece_id=7QRDZCQMJQXCWIBKNVDD7CGUPB7IJIQLI25ML7MU53IEACVIJH4Q, seg_pos={0 0}, upload=271458]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: write tcp 139.59.144.22:34086->185.167.204.205:4013: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:32:14.632831161 (308h36m52.516785367s) [noise=true , address=185.167.204.205:4003 , piece_id=6BVPAB6HXQE3ZQQXA7Y2HMVUWZ4Y75LBFKNQZZWEOU3MG43ZJMYA, seg_pos={0 0}, upload=271458]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 139.59.144.22:37234->185.167.204.205:4003: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:32:14.637057292 (308h36m52.521011494s) [noise=true , address=89.149.201.147:4018 , piece_id=AQ2MXSJSZVBISBE25ITXVPTXTOGEPV4R6UGFCPNUQUNCTH67UROA, seg_pos={0 0}, upload=271458]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: write tcp 139.59.144.22:37236->89.149.201.147:4018: write: connection refused; conn closed: op Jan 28 12:32:14.699552765 (308h36m52.583506965s) [upload=271458]: Next returned nil segment Jan 28 12:32:14.699570054 (308h36m52.583524264s) [upload=271458]: Waiting for error group managing segments... Jan 28 12:32:14.722668145 (308h36m52.606622335s) [noise=true , address=185.167.204.206:4057 , piece_id=OE67UVXUMK64P6ILCLQLIOPRFE4256KDRWLZKQQVHY3UKJDE4F4A, seg_pos={0 0}, upload=271458]: Done uploading piece. err: <nil> Jan 28 12:32:14.742845360 (308h36m52.62679956s) [noise=true , address=185.167.204.206:4065 , piece_id=LOY4BJWFCJOXPNVMEXCLSW5D7XVK7GNMA7VEH3FRSU7GUAF2KJXA, seg_pos={0 0}, upload=271458]: Done uploading piece. err: <nil> Jan 28 12:32:14.743286395 (308h36m52.627240594s) [noise=true , address=89.149.201.147:4023 , piece_id=6NF6CVDFNH2SKO33VTDWBQBOCCUCMG7HM2URVVYB2IKBED3XRFIQ, seg_pos={0 0}, upload=271458]: Done uploading piece. err: <nil> Jan 28 12:32:14.743495862 (308h36m52.627450063s) [noise=true , address=185.167.204.205:4027 , piece_id=66DMKQVWFFJSN7YNSROUQDS3OHKMQ3HXIBFZ4RVHIST6GEWWI6HQ, seg_pos={0 0}, upload=271458]: Done uploading piece. err: <nil> Jan 28 12:32:14.745409803 (308h36m52.629364004s) [noise=true , address=185.167.204.205:4034 , piece_id=3M6QJXQADT642TCIORIWVKEBSFF2UWH2GKV67GYXQKATVNKEW3IA, seg_pos={0 0}, upload=271458]: Done uploading piece. err: <nil> Jan 28 12:32:14.746195011 (308h36m52.630149215s) [noise=true , address=81.171.14.70:4048 , piece_id=GHOU35SBDFZY4DNCSSGOWSTL3CWURQIK5H4HGBGNINRKWXYGAEPA, seg_pos={0 0}, upload=271458]: Done uploading piece. err: <nil> Jan 28 12:32:15.207755270 (308h36m53.091709459s) [noise=true , address=89.149.201.147:4020 , piece_id=KB2AVFNQFFRP4G5RJVDDAMWCP6MVOPPMWGZT2KJAIJYACHGONXWA, seg_pos={0 0}, upload=271458]: Done uploading piece. err: <nil> Jan 28 12:32:15.214250187 (308h36m53.098204383s) [noise=true , address=89.149.201.147:4021 , piece_id=MQWK2USOCNLD3GF5B6J4PSTI5ZGX7DOBTWHKGQ5NTSYL7K5ZJVSQ, seg_pos={0 0}, upload=271458]: Done uploading piece. err: <nil> Jan 28 12:32:15.222412506 (308h36m53.106366717s) [noise=true , address=89.149.201.147:4024 , piece_id=2MHH2OR2GCTB6U422BLDIUFA347QHFMPGO5TNR2JUXG4LZG2DXCQ, seg_pos={0 0}, upload=271458]: Done uploading piece. err: <nil> Jan 28 12:32:15.223851278 (308h36m53.107805472s) [noise=true , address=81.171.14.70:4025 , piece_id=WNKTKEWM6JNLL3ALZV3N4H2X5U7YARIQVH2HN6P3AYFX4NSXK4OQ, seg_pos={0 0}, upload=271458]: Done uploading piece. err: <nil> Jan 28 12:32:15.229149005 (308h36m53.113103195s) [noise=true , address=81.171.14.70:4032 , piece_id=LYQO62FQWRBKMBJDZPL4XTY2SJDMIIZVZNIKBJD4HEJH2R55DNNQ, seg_pos={0 0}, upload=271458]: Done uploading piece. err: <nil> Jan 28 12:32:15.234436306 (308h36m53.118390507s) [noise=true , address=81.171.14.70:4036 , piece_id=ICTAYFYUDPGYZLMGPFRQJ64LCPFV5224Z6BTOIVX6IDBUJZJ2C3Q, seg_pos={0 0}, upload=271458]: Done uploading piece. err: <nil> Jan 28 12:32:15.242120285 (308h36m53.126074474s) [noise=true , address=81.171.14.70:4046 , piece_id=T2KZSUZKI2F3Y35DM7FMZAIVUUSDIEASRROUOXPPGQJUWUM7YAPQ, seg_pos={0 0}, upload=271458]: Done uploading piece. err: <nil> Jan 28 12:32:15.255382411 (308h36m53.139336627s) [noise=true , address=81.171.14.70:4027 , piece_id=F3NPYO3FV6E5BNBECPU6EONTPXGJU6N3HKJDZ4PK5LKEPA3BW55A, seg_pos={0 0}, upload=271458]: Done uploading piece. err: <nil> Jan 28 12:33:04.095871094 (308h37m41.97982533s) [noise=true , address=89.149.201.147:4017 , piece_id=CF5JROXMMV57AVSXHDGUQI2JU3TETSUD3VHYZKIGWE62VR5GXI6Q, seg_pos={0 0}, upload=271458]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 139.59.144.22:52940->89.149.201.147:4017: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:33:14.534454135 (308h37m52.418408358s) [noise=true , address=89.149.201.147:4014 , piece_id=OUNSHBYD3E5UDWMCOSGRAHM5TVBKQF66JZTRMTZHIHG3GPG5SRYQ, seg_pos={0 0}, upload=271458]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 139.59.144.22:45116->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:33:14.534539253 (308h37m52.418493452s) [noise=true , address=185.167.204.205:4009 , piece_id=DY2LAPJGT4BBRZTQ3ILYKTRY625A7VBUEYVAR343ZSGTWTZBCAVA, seg_pos={0 0}, upload=271458]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: read tcp 139.59.144.22:53070->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:33:14.534721386 (308h37m52.418675593s) [noise=true , address=89.149.201.147:4012 , piece_id=UYXOBEOQAV4IYSCBMHQ35TL4JBJF7DGQIHUCMMPBX3N4X67WDQ7Q, seg_pos={0 0}, upload=271458]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 139.59.144.22:43356->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:33:14.534743959 (308h37m52.418698159s) [noise=true , address=89.149.201.147:4005 , piece_id=ZIJKH2M7B66U4TWGJNW3WKDSP576OSCZCHLESVSDHELOMGRY3KNA, seg_pos={0 0}, upload=271458]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 139.59.144.22:47238->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:33:14.534904318 (308h37m52.41885852s) [noise=true , address=89.149.201.147:4007 , piece_id=SCQJCZBMKXODOT4IJ6VO45AD2NC7BZ7TC5J4IIATKYNWYU6HFP3Q, seg_pos={0 0}, upload=271458]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 139.59.144.22:59672->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:33:14.535077895 (308h37m52.419032162s) [noise=true , address=89.149.201.147:4004 , piece_id=4QNFGVW4JGTSPDWCUBVJKCZ44QRZB4FPVTVVBIAVOUYPXYU3HDZQ, seg_pos={0 0}, upload=271458]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 139.59.144.22:51768->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:33:14.535174398 (308h37m52.419128665s) [noise=true , address=89.149.201.147:4002 , piece_id=PTMI35JRESH7EREZUX5GRLUWH4VOX3VQMJEDECUYV6FOT7IX3K4Q, seg_pos={0 0}, upload=271458]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 139.59.144.22:50624->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:33:14.535209456 (308h37m52.419163646s) [seg_pos={0 0}, upload=271458]: Done waiting for segment. successful: 14 optimal: 26 errs: <nil> Jan 28 12:33:14.551524472 (308h37m52.435478675s) [upload=271458]: Done uploading segments... Jan 28 12:33:14.551572602 (308h37m52.435526813s) [upload=271458]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 14) Duration: 1m0.02037037s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.018632951s trace: https://jaeger.dev.storj.io/trace/7a3fe79d89421775 FAIL (2026-01-28 12:31:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== e... Jan 28 12:30:59.856453356 (308h35m37.740407565s) [noise=true , address=81.171.14.70:4048 , piece_id=B2KR2O7Y25MJMKYA3F7OTOFQQA7XB3RVR7IUIAILP5NL5QA3I2PQ, seg_pos={0 0}, upload=271440]: Uploading piece... Jan 28 12:30:59.858385591 (308h35m37.742339801s) [noise=true , address=185.167.204.205:4005 , piece_id=6HR2CYXQOEQZREC7FSRYTXXHFTPVEXOBTMQGDFNBA3EXZBIXGXSA, seg_pos={0 0}, upload=271440]: Uploading piece... Jan 28 12:30:59.860163168 (308h35m37.744117358s) [noise=true , address=185.167.204.205:4014 , piece_id=26U2QNK2QQ55BTM7XZPQNMXDZ7OSZDHN7NXKQSUTOWXQNT7YIYNA, seg_pos={0 0}, upload=271440]: Uploading piece... Jan 28 12:30:59.861900477 (308h35m37.745854688s) [noise=true , address=185.167.204.206:4048 , piece_id=C2FJHCB53FLLIKCULRZ6MJEGRBBUQIISLJWGUPGV77IHS4K6DOXQ, seg_pos={0 0}, upload=271440]: Uploading piece... Jan 28 12:30:59.863647898 (308h35m37.747602107s) [noise=true , address=81.171.14.70:4047 , piece_id=K5M4TA6X22ETWNLMECEKXWZUMEL6QVP2YF3SUUSAYLL42QBKLJCQ, seg_pos={0 0}, upload=271440]: Uploading piece... Jan 28 12:30:59.865567596 (308h35m37.749521816s) [noise=true , address=185.167.204.205:4009 , piece_id=RYXFRU6FDTHX34ROZU7OJAGGD3L5YM74QUUKRQOVS6ZKQB2MUT6A, seg_pos={0 0}, upload=271440]: Uploading piece... Jan 28 12:30:59.866199543 (308h35m37.750153755s) [noise=true , address=185.167.204.205:4002 , piece_id=TQ5QZJQNEI5UIEB6NOVMWJFXTLK4DLXVDIY7QGWH3X4I77VIDNGA, seg_pos={0 0}, upload=271440]: Uploading piece... Jan 28 12:30:59.867846944 (308h35m37.751801152s) [noise=true , address=89.149.201.147:4014 , piece_id=FMC7JAPX6WRG7SMMFE26QBO6Z2ZEF72JWW6OMVAAUGFXUE36L5ZQ, seg_pos={0 0}, upload=271440]: Uploading piece... Jan 28 12:30:59.873969336 (308h35m37.757923545s) [noise=true , address=185.167.204.205:4010 , piece_id=4J6GCBYA7VXGRMTDSC23D3R6XK3ZEOMMSWRL5N2UH2WQOGLYEMKA, seg_pos={0 0}, upload=271440]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: write tcp 139.59.144.22:43440->185.167.204.205:4010: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:30:59.902844229 (308h35m37.786798434s) [noise=true , address=185.167.204.205:4005 , piece_id=6HR2CYXQOEQZREC7FSRYTXXHFTPVEXOBTMQGDFNBA3EXZBIXGXSA, seg_pos={0 0}, upload=271440]: Done uploading piece. err: ecclient: upload failed (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM, address:185.167.204.205:4005): protocol: write tcp 139.59.144.22:35804->185.167.204.205:4005: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:30:59.903333101 (308h35m37.787287305s) [noise=true , address=185.167.204.205:4002 , piece_id=TQ5QZJQNEI5UIEB6NOVMWJFXTLK4DLXVDIY7QGWH3X4I77VIDNGA, seg_pos={0 0}, upload=271440]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:30:59.952513007 (308h35m37.836467207s) [upload=271440]: Next returned nil segment Jan 28 12:30:59.952559414 (308h35m37.836513655s) [upload=271440]: Waiting for error group managing segments... Jan 28 12:30:59.975335140 (308h35m37.85928935s) [noise=true , address=81.171.14.70:4044 , piece_id=IBDZR4U52P7NTMCMI6L5BSE66MTZIX4S4ZHMVRZIGFHCITINFAKQ, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:30:59.976641326 (308h35m37.860595528s) [noise=true , address=185.167.204.206:4066 , piece_id=4W6H6U5QP6AGYBUS4OO53K62ZYFBQJVMPPMIHKNOO43CRA6TN24Q, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:30:59.977105008 (308h35m37.861059202s) [noise=true , address=81.171.14.70:4048 , piece_id=B2KR2O7Y25MJMKYA3F7OTOFQQA7XB3RVR7IUIAILP5NL5QA3I2PQ, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:30:59.979697584 (308h35m37.863651774s) [noise=true , address=89.149.201.147:4024 , piece_id=XOE5INBWYAUYTUCYREBDD3FY36SZRM5MRDEK3C557GXVCBRLFKEA, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:30:59.979721388 (308h35m37.86367559s) [noise=true , address=185.167.204.205:4023 , piece_id=7R4BYLKLZIHJRIK2SFWMYLFA6IVP2ISRN2WPOBKVJW63HYBYKUKA, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:30:59.980231508 (308h35m37.864185715s) [noise=true , address=81.171.14.70:4038 , piece_id=MMJJ3OKWUYK73KQFOL6GPNNHVO2LHIEENH7NL2ZJGOFICYKSTBUQ, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:30:59.980803855 (308h35m37.864758056s) [noise=true , address=185.167.204.205:4027 , piece_id=WPUNLGYJEDDJBUFGYZCFZXH6I3NUI2LFYEDPV26DYI2XT6MMPOXQ, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:30:59.985753333 (308h35m37.869707537s) [noise=true , address=185.167.204.205:4022 , piece_id=E2SWZIR6H56FWNNRPPJLONTDVBBACM2RN3OFQHOICJ34XCLAKTIA, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:30:59.986624403 (308h35m37.870578605s) [noise=true , address=185.167.204.206:4069 , piece_id=MYAOQ4OSHYYKBSMDZF556FJUYY53IQG7Y4OU3X5ZSO2USQUR4JYA, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:30:59.993046010 (308h35m37.87700021s) [noise=true , address=89.149.201.147:4021 , piece_id=QL7HGWRHNUIDNYJTXUQNTZJCMZDQP5SBIQ557VJEO4WTLZLMTUBA, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:30:59.993359153 (308h35m37.877313355s) [noise=true , address=185.167.204.206:4063 , piece_id=HQ27M5W2FAIJWUT3ZXTJSHJ5QWG6DZWYY55LQJJJQRN4QQBXDY6A, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:30:59.995896169 (308h35m37.879850362s) [noise=true , address=81.171.14.70:4032 , piece_id=MONAWQ7TF4PEYP5VVP4F5US5UA4E7V6RMGVWVOIAYEWH52JNQFDQ, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:30:59.997733387 (308h35m37.881687584s) [noise=true , address=81.171.14.70:4047 , piece_id=K5M4TA6X22ETWNLMECEKXWZUMEL6QVP2YF3SUUSAYLL42QBKLJCQ, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:30:59.997757290 (308h35m37.881711477s) [noise=true , address=89.149.201.147:4018 , piece_id=SDUEUTQ5SF77XZGRT4XEYLWTV6O2BBCBFFKZSTFLHDDQV27GOCDA, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:31:00.003476399 (308h35m37.887430609s) [noise=true , address=185.167.204.206:4048 , piece_id=C2FJHCB53FLLIKCULRZ6MJEGRBBUQIISLJWGUPGV77IHS4K6DOXQ, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:31:00.023108472 (308h35m37.90706268s) [noise=true , address=81.171.14.70:4040 , piece_id=HCJZUH6TRMAZOPREHHEW3SRBJYPVILOTWHON2BTSTL3DNOL3SW7Q, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:31:00.035579372 (308h35m37.919533562s) [noise=true , address=81.171.14.70:4028 , piece_id=24H43AZKTM3ORXQC4QYFIKLHDCZCUNQZFQPTUVLEK4AY3JQGO7GA, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:31:00.041856848 (308h35m37.925811062s) [noise=true , address=81.171.14.70:4035 , piece_id=WUCRUN7BSSISOYK5GQOWHNW75EKKCXXUM3JMTJIKH62BLB344HPQ, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:31:00.053995983 (308h35m37.937950194s) [noise=true , address=185.167.204.205:4014 , piece_id=26U2QNK2QQ55BTM7XZPQNMXDZ7OSZDHN7NXKQSUTOWXQNT7YIYNA, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:31:00.056354971 (308h35m37.94030917s) [noise=true , address=89.149.201.147:4014 , piece_id=FMC7JAPX6WRG7SMMFE26QBO6Z2ZEF72JWW6OMVAAUGFXUE36L5ZQ, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:31:00.433711735 (308h35m38.31766594s) [noise=true , address=89.149.201.147:4016 , piece_id=YCU32YJKRUZ4JPE66AXJULZTXQ25EWN2WDOZ47I7RQTP2GDXBLAQ, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:31:00.484771422 (308h35m38.368725623s) [noise=true , address=81.171.14.70:4026 , piece_id=SFOIDWRVKLXIN4TQVPPIC53BPMO2LET7IG4NG35UIHMKGF7WNLAQ, seg_pos={0 0}, upload=271440]: Done uploading piece. err: <nil> Jan 28 12:31:59.774269554 (308h36m37.658223759s) [noise=true , address=185.167.204.205:4009 , piece_id=RYXFRU6FDTHX34ROZU7OJAGGD3L5YM74QUUKRQOVS6ZKQB2MUT6A, seg_pos={0 0}, upload=271440]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: read tcp 139.59.144.22:40480->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:31:59.774491238 (308h36m37.658445442s) [noise=true , address=185.167.204.205:4006 , piece_id=76H67LLELQK36TAVQZU5H56252LS4YKFUUJFPVMFV3PIWGAAPF7A, seg_pos={0 0}, upload=271440]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: read tcp 139.59.144.22:45076->185.167.204.205:4006: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:31:59.774508061 (308h36m37.658462254s) [noise=true , address=89.149.201.147:4004 , piece_id=K5FTJ25KGAEDEO3SLDXARQVPXWR23E2B22AEZOXGWXNRT5RXKWDQ, seg_pos={0 0}, upload=271440]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 139.59.144.22:42096->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:31:59.774534477 (308h36m37.658488667s) [seg_pos={0 0}, upload=271440]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Jan 28 12:31:59.789959019 (308h36m37.673913255s) [upload=271440]: Done uploading segments... Jan 28 12:31:59.790002121 (308h36m37.67395633s) [upload=271440]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 1m0.018649243s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.026120539s trace: https://jaeger.dev.storj.io/trace/d44c1ec373c633d FAIL (2026-01-28 12:30:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== g_pos={0 0}, upload=271426]: Uploading piece... Jan 28 12:29:59.649716553 (308h34m37.533670756s) [noise=true , address=185.167.204.205:4026 , piece_id=TLL3XE3ZCTOVHMJDXL4ZFGI74Y5ARHAARBTWKGCMAOO7QQVQQYWA, seg_pos={0 0}, upload=271426]: Uploading piece... Jan 28 12:29:59.650023983 (308h34m37.533978191s) [noise=true , address=185.167.204.206:4040 , piece_id=DIDTQVJUTX5XBJUO6ML4R2KL6JPSU5OHOWLSV6XV673OBWYMDOVA, seg_pos={0 0}, upload=271426]: Uploading piece... Jan 28 12:29:59.650030090 (308h34m37.533984276s) [noise=true , address=185.167.204.206:4057 , piece_id=RBCV4JNK3LZQT3542H6FCKEKXOOZZJFQXVJKMU2SLDSNA5PIV2PQ, seg_pos={0 0}, upload=271426]: Uploading piece... Jan 28 12:29:59.650443784 (308h34m37.534397994s) [noise=true , address=185.167.204.205:4007 , piece_id=26HE3HYUEAZAVJ35LBTKLN3SCHG7WFAFZV5X7EHWIKV34UQE4IHQ, seg_pos={0 0}, upload=271426]: Uploading piece... Jan 28 12:29:59.650888247 (308h34m37.534842456s) [noise=true , address=81.171.14.70:4026 , piece_id=IAR5NI54IF5F755YUF5WQXRCHZDFMNBW7LHYINNEJI2B3N2PSYKQ, seg_pos={0 0}, upload=271426]: Uploading piece... Jan 28 12:29:59.651286844 (308h34m37.535241059s) [noise=true , address=185.167.204.206:4038 , piece_id=4O36FDMIZ6XDUXA7O7WEA2VZTFE5RTA6OFICBSC7IV65EZBGSL6Q, seg_pos={0 0}, upload=271426]: Uploading piece... Jan 28 12:29:59.651673390 (308h34m37.535627595s) [noise=true , address=81.171.14.70:4037 , piece_id=P7K6J3FZTTBL6HXC6CEJXCB5A6PEESKXW2REISAYWC63AV4CUFKQ, seg_pos={0 0}, upload=271426]: Uploading piece... Jan 28 12:29:59.652060315 (308h34m37.536014523s) [noise=true , address=89.149.201.147:4012 , piece_id=7SFJGS3PVXBC4BJOFEIBAS5TULRU5TJ54XPFGY6GG23ERD4DV45Q, seg_pos={0 0}, upload=271426]: Uploading piece... Jan 28 12:29:59.652466143 (308h34m37.536420348s) [noise=true , address=185.167.204.206:4061 , piece_id=AVIGAT2DYCEXPGXZ4DJ3LECV5XTMUO2FNJQXWQFPURMOS544Z6EQ, seg_pos={0 0}, upload=271426]: Uploading piece... Jan 28 12:29:59.698362200 (308h34m37.582316402s) [noise=true , address=185.167.204.205:4001 , piece_id=XS2NOO4NFFPJLQSWM6AFMXZW4FJY6WKKLCLTHLLTZCTR5XPWBJTQ, seg_pos={0 0}, upload=271426]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 139.59.144.22:36622->185.167.204.205:4001: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:29:59.710498683 (308h34m37.594452892s) [noise=true , address=185.167.204.205:4007 , piece_id=26HE3HYUEAZAVJ35LBTKLN3SCHG7WFAFZV5X7EHWIKV34UQE4IHQ, seg_pos={0 0}, upload=271426]: Done uploading piece. err: ecclient: upload failed (node:12m7e6EGQBC1wvbRQ5uwG8wuHbgZeyXPdj5XDMi1kgo5woPgXR, address:185.167.204.205:4007): protocol: write tcp 139.59.144.22:47068->185.167.204.205:4007: write: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:29:59.753597780 (308h34m37.637551982s) [upload=271426]: Next returned nil segment Jan 28 12:29:59.753613808 (308h34m37.637568017s) [upload=271426]: Waiting for error group managing segments... Jan 28 12:29:59.784587744 (308h34m37.668541943s) [noise=true , address=89.149.201.147:4019 , piece_id=HQT72TOPCVPEYKWJQVUNVAG2QYILWATWKOZ7ARIF57DCU5U4DRZQ, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.786909891 (308h34m37.670864094s) [noise=true , address=185.167.204.205:4026 , piece_id=TLL3XE3ZCTOVHMJDXL4ZFGI74Y5ARHAARBTWKGCMAOO7QQVQQYWA, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.790511676 (308h34m37.674465882s) [noise=true , address=185.167.204.205:4030 , piece_id=V3DPXE54EK4PYCD3WOSMAX3LRB4BIK2ANSWUGIBJPXYPEDRWMHIA, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.791721587 (308h34m37.675675774s) [noise=true , address=185.167.204.206:4061 , piece_id=AVIGAT2DYCEXPGXZ4DJ3LECV5XTMUO2FNJQXWQFPURMOS544Z6EQ, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.791749198 (308h34m37.675703386s) [noise=true , address=185.167.204.206:4057 , piece_id=RBCV4JNK3LZQT3542H6FCKEKXOOZZJFQXVJKMU2SLDSNA5PIV2PQ, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.792413637 (308h34m37.676367828s) [noise=true , address=81.171.14.70:4028 , piece_id=ZMZHLO7KCOFVP5SPSQHOGMXPKOT3KSVQO5WW3HDLRBNIOOHIJIDA, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.793572799 (308h34m37.677526988s) [noise=true , address=185.167.204.206:4051 , piece_id=IT3QRKJ26TKTGZBFAY5CYI3JZAUK524OBZ7G7LZKOHNJ25JEEB6A, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.798792438 (308h34m37.68274664s) [noise=true , address=81.171.14.70:4048 , piece_id=EIMXT4AQFMA5R5FE2PYLCS7BIMV3X32AP3VBY56ONPNVUCUMA3JA, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.799205246 (308h34m37.68315945s) [noise=true , address=81.171.14.70:4036 , piece_id=Z3C27K6XNPJNRDMIX3WDIPCO33ABL2KHNDAHTFQWSQTTVOEH3GTA, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.802975345 (308h34m37.68692955s) [noise=true , address=81.171.14.70:4026 , piece_id=IAR5NI54IF5F755YUF5WQXRCHZDFMNBW7LHYINNEJI2B3N2PSYKQ, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.808741182 (308h34m37.69269538s) [noise=true , address=185.167.204.206:4072 , piece_id=OTKRR6DTNEL67MGXRAZ6JTHO5VXKAG325FSUFAG4HXZOXC2GVDAQ, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.814833533 (308h34m37.698787732s) [noise=true , address=185.167.204.206:4044 , piece_id=RZK2W6YUW76YQETNF7Z73S5A7L35L7EVON5MYSY6HHRJHZLYS6RA, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.815241742 (308h34m37.69919594s) [noise=true , address=89.149.201.147:4010 , piece_id=2GUSRDYABPJEBWCNLTKYQYKBGXIYDDUVJ43HG6UCX22OTLHMXFGA, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.815750938 (308h34m37.699705137s) [noise=true , address=185.167.204.206:4040 , piece_id=DIDTQVJUTX5XBJUO6ML4R2KL6JPSU5OHOWLSV6XV673OBWYMDOVA, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.818491501 (308h34m37.702445712s) [noise=true , address=185.167.204.205:4023 , piece_id=ILZY4DSQCRBKPUIRITU672OODUQYFPHVCIQRXG4MHCFWAM7O6I7Q, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.821141249 (308h34m37.70509545s) [noise=true , address=185.167.204.206:4038 , piece_id=4O36FDMIZ6XDUXA7O7WEA2VZTFE5RTA6OFICBSC7IV65EZBGSL6Q, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.821770042 (308h34m37.705724241s) [noise=true , address=81.171.14.70:4037 , piece_id=P7K6J3FZTTBL6HXC6CEJXCB5A6PEESKXW2REISAYWC63AV4CUFKQ, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.822802664 (308h34m37.706756872s) [noise=true , address=185.167.204.206:4037 , piece_id=EMVZIEMHKIJDFGH2L5RUGV6HNZUQXVSIIUSZKMTWV2T66VTCSPAA, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.828432162 (308h34m37.712386361s) [noise=true , address=81.171.14.70:4043 , piece_id=54W72ETYIGJTS3SUCOQCEVIZNCIF4N2OWEBUREHDHGNRV6YRANKA, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.837038304 (308h34m37.720992508s) [noise=true , address=81.171.14.70:4047 , piece_id=UXIELYAM5CII7AWYXUZBH6M3DUYC3RXYYUHSDEO6JXKGRF6AJIPQ, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.846810875 (308h34m37.730765084s) [noise=true , address=81.171.14.70:4040 , piece_id=QFX3KMP4E3LAAMQVTIPC5JQJSLFOY3ILE2W6JC6SA4UQZOSL6YGA, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.848929052 (308h34m37.732883251s) [noise=true , address=185.167.204.206:4039 , piece_id=YIR5BOU46L5PJYK7KBAMIQEPIMZMDDRWRD4I6D33M5JDO5IQIBKQ, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:29:59.875375120 (308h34m37.75932931s) [noise=true , address=89.149.201.147:4012 , piece_id=7SFJGS3PVXBC4BJOFEIBAS5TULRU5TJ54XPFGY6GG23ERD4DV45Q, seg_pos={0 0}, upload=271426]: Done uploading piece. err: <nil> Jan 28 12:30:59.609122053 (308h35m37.493076255s) [noise=true , address=185.167.204.205:4009 , piece_id=SBWY6EVXTPVBYPNKQMGJROZVWYDFH4N2LLTCWKA4LGZ6RPECE5YQ, seg_pos={0 0}, upload=271426]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: read tcp 139.59.144.22:52822->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:30:59.609988203 (308h35m37.493942412s) [noise=true , address=89.149.201.147:4005 , piece_id=SGEDHDDLDWUPAZO4X7ZIQBE762LEK2S4QEIBUYU6CUGY5R544APQ, seg_pos={0 0}, upload=271426]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 139.59.144.22:41862->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:30:59.610050936 (308h35m37.494005145s) [noise=true , address=89.149.201.147:4007 , piece_id=ZG6HDJDAQEZDADGPQE2APRMS6RHAB2AWRWMVYFJ2AGWYR6NEN5IA, seg_pos={0 0}, upload=271426]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 139.59.144.22:38314->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 12:30:59.610132270 (308h35m37.494086455s) [seg_pos={0 0}, upload=271426]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Jan 28 12:30:59.632529273 (308h35m37.516483482s) [upload=271426]: Done uploading segments... Jan 28 12:30:59.632601671 (308h35m37.516555871s) [upload=271426]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 1m0.026145974s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.650785013s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 08:04:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.650810594s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.458730291s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 08:04:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.458760039s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.34526974s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 08:03:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.345285058s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.318828939s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 08:02:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.318860806s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.485842346s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 08:01:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.485876484s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.374017285s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 08:01:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.374048329s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 1.62084928s trace: https://jaeger.dev.storj.io/trace/1b35a6c2abc67a0b FAIL (2026-01-28 08:00:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.620941342s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.X..........................................................] duration: 2.227271701s trace: https://jaeger.dev.storj.io/trace/1b35a6c2abc67a0b FAIL (2026-01-28 08:00:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.22729888s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.383476987s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 07:59:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.383501296s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.45802341s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 07:59:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.458112671s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..X.........................................................] duration: 1.58987548s trace: https://jaeger.dev.storj.io/trace/1b35a6c2abc67a0b FAIL (2026-01-28 07:58:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.589908618s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...X........................................................] duration: 1.890185422s trace: https://jaeger.dev.storj.io/trace/1b35a6c2abc67a0b FAIL (2026-01-28 07:58:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.890454536s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.423432557s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 07:57:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.423458111s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.3520596s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 07:57:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.352132708s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....X.......................................................] duration: 1.666784785s trace: https://jaeger.dev.storj.io/trace/1b35a6c2abc67a0b FAIL (2026-01-28 07:57:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.666812408s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.488966649s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 07:57:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.488992471s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....X......................................................] duration: 1.727074278s trace: https://jaeger.dev.storj.io/trace/1b35a6c2abc67a0b FAIL (2026-01-28 07:56:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.72711999s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......X.....................................................] duration: 1.626345946s trace: https://jaeger.dev.storj.io/trace/1b35a6c2abc67a0b FAIL (2026-01-28 07:56:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.626363095s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......X....................................................] duration: 1.689022079s trace: https://jaeger.dev.storj.io/trace/1b35a6c2abc67a0b FAIL (2026-01-28 07:56:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.689053802s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.411318743s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 07:55:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.411343239s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.318799927s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 07:55:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.318887352s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.339262535s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 07:55:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.339297818s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 1.680458138s trace: https://jaeger.dev.storj.io/trace/1b35a6c2abc67a0b FAIL (2026-01-28 07:54:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.680699945s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.405812476s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 07:53:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.405837081s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 1.518955224s trace: https://jaeger.dev.storj.io/trace/1b35a6c2abc67a0b FAIL (2026-01-28 07:53:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.518985901s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 1.605468486s trace: https://jaeger.dev.storj.io/trace/1b35a6c2abc67a0b FAIL (2026-01-28 07:53:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.605543507s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.447685428s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 07:52:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.447714946s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 1.531928044s trace: https://jaeger.dev.storj.io/trace/1b35a6c2abc67a0b FAIL (2026-01-28 07:52:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.531960334s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.504919846s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 07:52:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.504956457s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............X...............................................] duration: 1.586180079s trace: https://jaeger.dev.storj.io/trace/1b35a6c2abc67a0b FAIL (2026-01-28 07:51:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.586281318s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.415484052s trace: https://jaeger.dev.storj.io/trace/6fbf8730f87aca76 FAIL (2026-01-28 07:51:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Jan 28 07:17:49.676479742 (303h22m27.560433947s) [upload=266879]: Starting upload Jan 28 07:17:49.676584638 (303h22m27.560538841s) [upload=266879]: Done starting upload Jan 28 07:17:49.676636377 (303h22m27.560590567s) [upload=266879]: Uploading segments... Jan 28 07:17:49.676986869 (303h22m27.560941075s) [upload=266879]: Got next segment. Inline: false Jan 28 07:17:49.677059537 (303h22m27.56101374s) [upload=266879]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 28 07:17:49.677067291 (303h22m27.561021495s) [upload=266879]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 28 07:17:49.832241395 (303h22m27.716195603s) [seg_pos={0 0}, upload=266879]: Begin upload segment... Jan 28 07:17:49.832346487 (303h22m27.716300689s) [seg_pos={0 0}, upload=266879]: Done begin upload segment. Jan 28 07:17:49.832406382 (303h22m27.716360592s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832419660 (303h22m27.71637386s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832509156 (303h22m27.716463358s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.832990487 (303h22m27.716944694s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833008325 (303h22m27.716962527s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833320262 (303h22m27.717274465s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833521382 (303h22m27.717475581s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833622323 (303h22m27.717576528s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.833977469 (303h22m27.717931668s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834003319 (303h22m27.717957526s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834361445 (303h22m27.718315644s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834473447 (303h22m27.718427655s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.834792088 (303h22m27.718746292s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835272256 (303h22m27.71922646s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.835675434 (303h22m27.719629639s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:49.837043217 (303h22m27.720997418s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Uploading piece... Jan 28 07:17:50.436877102 (303h22m28.320831307s) [upload=266879]: Next returned nil segment Jan 28 07:17:50.436895500 (303h22m28.32084971s) [upload=266879]: Waiting for error group managing segments... Jan 28 07:17:50.567034817 (303h22m28.45098902s) [noise=true , address=77.90.31.18:4805 , piece_id=FMAJD2N7HTG6TMIQE6RFLONGCUBC4SKENCL3C5DJEOCNT56CYBQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.567147706 (303h22m28.451101905s) [noise=true , address=77.90.31.14:4664 , piece_id=3LS2HEBTWG5Z42ULAXN2K6NVXSZHANKVPOTLR4JOJTRKUR3GRR5Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.569653279 (303h22m28.453607499s) [noise=true , address=145.79.227.37:4566 , piece_id=KOT3CODXYOZEOYMZ7LKFLENE3IIKZ5TFKCLKYBSMQCOVG5KICBPQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.572464610 (303h22m28.456418801s) [noise=true , address=145.79.227.10:4403 , piece_id=6IHI2NITQKLG7IWVGYL6IQU7IWO5PWQONJBFAWVZNPDJSFV6M5FA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.575267364 (303h22m28.459221553s) [noise=true , address=145.79.227.50:4373 , piece_id=EJXAG6APVN7PBOZI35YZVH6Q244WIPH6SEPMOUJLIGGEUIQE76GA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576049566 (303h22m28.460003767s) [noise=true , address=145.79.227.15:4876 , piece_id=2WT7T67YVCLHH5LIZRWYZSUGIMIWQYN2SIPOBIQFEJ7LN6WF7QGQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.576708768 (303h22m28.460662967s) [noise=true , address=145.79.227.41:4085 , piece_id=GU5WSV5JNR6TGRS3BN2USORY3QM6I36GTSVGTOM67GLJMIE35UMQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.579136219 (303h22m28.463090409s) [noise=true , address=145.79.227.33:4869 , piece_id=WKQFSBEZ6SALG4TOHHR7BVBALRM5P2S6NFPLTJ2QPOBB4WF2YZQA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.580870099 (303h22m28.46482429s) [noise=true , address=145.79.227.43:4157 , piece_id=F2VIJQGN4DEY5IC42QT3DYMH7ZGAOSIGWLV6W43JMG4FNQH5TV2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.588153532 (303h22m28.472107731s) [noise=true , address=145.79.227.31:4798 , piece_id=ZYYAYR54SAY54TDKV3OP5PYTYIYSOSSKAATXISPNZNYEUV6RACTQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589444099 (303h22m28.473398297s) [noise=true , address=145.79.227.46:4603 , piece_id=ELTPASAB4G5OSJXAFP5CEKBBT25RWDAZL2XM7JJDFQAUFNVACOXQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:17:50.589864421 (303h22m28.47381862s) [noise=true , address=145.79.227.49:4337 , piece_id=CBCVJ6MIWYZVK42FXU47XWF5C6QMTRM6ET7ZLVSMJNUYL2ID4TSQ, seg_pos={0 0}, upload=266879]: Done uploading piece. err: <nil> Jan 28 07:18:19.379453822 (303h22m57.263408037s) [noise=true , address=45.91.116.5:4299 , piece_id=2OXWISYH27DER437MQKSZ4356MEMFRITLWP46LCI3JCUBQ2WBURA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379574546 (303h22m57.263528731s) [noise=true , address=45.91.116.6:4975 , piece_id=BFP2UTI4QF4DW3ZA43UYNI4JBJKDDPLKPR37G6C2ALHZ7DLHDSWA, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 139.59.144.22:44618->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379702232 (303h22m57.26365644s) [noise=true , address=45.91.116.7:4012 , piece_id=E4REYTDDL6NJFEOQ5F7Z5WFK6TBKNS43YPYMYYLYCADZTK3SUW2A, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1smg5DiC8TRGnnmoQrRpvScvehv8aqtA2DaKtD1JtAhrhnm96t, address:45.91.116.7:4012): protocol: context deadline exceeded; context deadline exceeded Jan 28 07:18:19.379781321 (303h22m57.263735531s) [noise=true , address=45.91.116.14:4190 , piece_id=5UYAYQCR6LNZVVVMMJXNP4HH7JYZDOP6KMAY4LYAI5ANSFSYBQ4Q, seg_pos={0 0}, upload=266879]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 139.59.144.22:53984->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 28 07:18:19.379814213 (303h22m57.263768416s) [seg_pos={0 0}, upload=266879]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jan 28 07:18:19.489959618 (303h22m57.373913828s) [upload=266879]: Done uploading segments... Jan 28 07:18:19.490001374 (303h22m57.373955584s) [upload=266879]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.415508697s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)