Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.224164767s trace: https://jaeger.dev.storj.io/trace/1418f9f06900bf6f FAIL (2026-01-07 03:28:14 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.224188248s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 920.096732ms trace: https://jaeger.dev.storj.io/trace/7b371892eef4dd63 FAIL (2026-01-07 03:28:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== , upload=686441]: Uploading piece... Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments... Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces. Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments... Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil> Duration: 920.12621ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................................XX..] duration: 144.94109ms trace: https://jaeger.dev.storj.io/trace/4b8a4595fd3a13 FAIL (2026-01-07 03:27:45 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 144.976073ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 424.436378ms trace: https://jaeger.dev.storj.io/trace/7b371892eef4dd63 FAIL (2026-01-07 03:27:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== , upload=686441]: Uploading piece... Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece... Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments... Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil> Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces. Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments... Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil> Duration: 424.463906ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.006384404s trace: https://jaeger.dev.storj.io/trace/1418f9f06900bf6f FAIL (2026-01-07 03:27:29 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 30.006408115s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 166.139204ms trace: https://jaeger.dev.storj.io/trace/4b8a4595fd3a13 FAIL (2026-01-07 03:26:59 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 166.161899ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.0014331s trace: https://jaeger.dev.storj.io/trace/4bc87ac83233e33f FAIL (2026-01-07 03:26:29 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 30.001457896s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.397555666s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:43:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.397586985s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.240512889s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:43:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.240543519s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 12.644352944s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:43:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 12.644384849s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.409191464s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:42:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.409221408s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 3.13996094s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:42:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 3.140054987s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.262320695s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:41:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.262434315s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 3.575670053s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:41:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 3.575710014s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 3.558365643s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:40:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 3.558411629s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.325048699s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:40:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.325074131s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 12.578210309s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:40:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 12.578241506s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.393861124s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:40:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.393887622s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.37517511s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:39:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.375220422s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 10.582052052s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:39:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 10.582083584s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 12.684621532s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:38:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 12.684648965s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.383113503s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:38:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.383189921s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.439611239s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:37:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.439636508s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 3.306705045s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:37:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 3.306729113s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.436419934s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:36:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.436463609s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 12.661142482s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:36:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 12.661164905s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.27651915s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:35:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.27653592s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.389429126s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:35:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.389467518s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 3.426309029s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:35:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 3.426336594s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 3.400984348s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:35:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 3.401020456s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 12.733788229s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:34:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 12.73401548s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.387542171s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:34:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.387569801s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.371259125s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:33:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.371284802s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 12.666940233s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:33:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 12.667057217s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.417274136s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:33:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.417313109s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 9.663167695s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:32:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 9.663193189s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.299124423s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:32:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.299157717s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 12.641750394s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:32:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 12.641796593s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 12.665345601s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:32:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 12.665386911s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.388131773s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:31:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.3882029s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 3.622415208s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:30:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 3.622442605s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.845104134s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:30:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.845126597s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 4.666385429s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:29:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 4.666413703s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.363738428s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:29:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.363770906s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.863998102s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:28:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 2.864035221s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 4.230026691s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:28:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 4.230057124s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 4.191021186s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:28:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 4.191047851s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.397243751s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:27:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.397278113s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 3.193307994s trace: https://jaeger.dev.storj.io/trace/5cf4e6a4e2080b2d FAIL (2026-01-06 20:27:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 4 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.233875032 (772h29m46.214227679s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234056119 (772h29m46.21440876s) [seg_pos={0 0}, upload=679912]: Done begin upload segment. Jan 6 19:58:06.234140741 (772h29m46.214493379s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234498043 (772h29m46.214850694s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.234792560 (772h29m46.215145197s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235003281 (772h29m46.215355922s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235277131 (772h29m46.215629772s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.235848449 (772h29m46.216201078s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.236290164 (772h29m46.216642812s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237033388 (772h29m46.217386026s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.237491382 (772h29m46.217844022s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.238084906 (772h29m46.218437545s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.239186345 (772h29m46.219538984s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.240506522 (772h29m46.220859165s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Uploading piece... Jan 6 19:58:06.829743229 (772h29m46.810095872s) [upload=679912]: Next returned nil segment Jan 6 19:58:06.829762199 (772h29m46.810114841s) [upload=679912]: Waiting for error group managing segments... Jan 6 19:58:06.947371887 (772h29m46.927724525s) [noise=true , address=145.79.227.32:4847 , piece_id=6U4VE2TTWB6DHTV2BHGWHPCZV7U64CS6RJULYUOKG2VTC27VCTRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.002507087 (772h29m46.982859763s) [noise=true , address=45.91.116.9:4266 , piece_id=GRLWIMJIAAUAJO3RISE3JWGJYCCQYWF7JRZFZR3SS46IUET67GPA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.039550016 (772h29m47.019902653s) [noise=true , address=145.79.227.32:4866 , piece_id=4DYLXPB62ILGSR7D3UD2AGN6QRE3TSXG423GEKDP4ZRQ4GAHC43Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.073221490 (772h29m47.053574126s) [noise=true , address=77.90.31.18:4834 , piece_id=IXY6FIN7YKAX7HIE6YYF6C3CT6JQB7OCD5YQA2R3NXPV7ZSVNO5A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.121426552 (772h29m47.101779189s) [noise=true , address=5.231.73.3:4020 , piece_id=XK5TJZYM3XT6RO3ZVA47TWZ5XY3HMUG77I6KIQKVVRRZ4YDFLQUQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.147306902 (772h29m47.127659539s) [noise=true , address=77.90.31.12:4620 , piece_id=6XLSTU3WU37AUBBK5BHHUYRNPSZ3XZFMMRNYPSHNDH5YSWJZXK3A, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.155135219 (772h29m47.135487858s) [noise=true , address=45.91.116.14:4202 , piece_id=HS3UHWQQ6APNCIVTI65RJDM2YLSPBR3EXEKBOII2EGB7J72SNKRA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.307741749 (772h29m47.288094384s) [noise=true , address=77.90.31.19:4874 , piece_id=ADOYQBYXPJP4GBZA5D6IB72OV5KSE6ESPPMH7C6LWFJIJRIL42FA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.440337127 (772h29m47.420689763s) [noise=true , address=45.91.116.13:4184 , piece_id=TYYXY6NHIXCO7OSL2RD3OKGOKU4MFRGT2BPCHEFYQ6B52VCFY2XQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.901506940 (772h29m47.88185958s) [noise=true , address=145.79.227.3:4170 , piece_id=SMIF5I6K5PZFLIKQ22Y7JWIVHT6SWVPLQALRIH5R6L4FVHVC7NGQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:07.932347050 (772h29m47.912699689s) [noise=true , address=145.79.227.29:4969 , piece_id=DNV6MFNNMQL5ZVQK2AIGYIAS6E5THGUDI4X4DLPTMJIH7YCPMPPQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.046430498 (772h29m48.026783134s) [noise=true , address=145.79.227.43:4168 , piece_id=NOFNWYEMG5BP622VSJGSR65FY264DRNWGSLI6YUXV6FTW7DXOOCA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.063258213 (772h29m48.043610858s) [noise=true , address=145.79.227.14:4866 , piece_id=NMEQDY2COSGV6K4JIYXEYQ2A66BJRRCOAGCFS2URAOWXUB23QM4Q, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218417658 (772h29m48.198770297s) [noise=true , address=145.79.227.30:4789 , piece_id=UYSB4JQOVVVK6LYXE7A72MBUU4VGT7TAXXVGNTWY25JMO4OGK3WQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: <nil> Jan 6 19:58:08.218446170 (772h29m48.198798807s) [seg_pos={0 0}, upload=679912]: Segment reached optimal threshold of 14 pieces. Jan 6 19:58:08.218679983 (772h29m48.199032625s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BdVmmJ1L1sEMcHXTAdXBXU6dmdhUE9VT74jCNdZj5bMqJWxqp): protocol: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33372->145.79.227.17:4004: use of closed network connection Jan 6 19:58:08.218688530 (772h29m48.199041166s) [noise=true , address=145.79.227.17:4004 , piece_id=QTPQKULKLEVKTBGB77DOQ47U4KL5IA2ND5PM4TTUBXVUXVVXXKAA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218829688 (772h29m48.199182333s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:08.218854097 (772h29m48.19920674s) [noise=true , address=193.149.164.143:4697 , piece_id=W5TECRY7CFBI2K6UYXYHNJP3YY3KCHOG4Q7VJAN7GC3EJ5FGJEZA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.218942630 (772h29m48.199295275s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: read tcp 139.59.144.22:56426->145.79.227.47:4285: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 6 19:58:08.218950936 (772h29m48.199303572s) [noise=true , address=145.79.227.47:4285 , piece_id=VUAB2QIWWFUJGCCELFDEKTMYG7YKL64I2AYGQOSA7X2EM6WKXCNA, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219048646 (772h29m48.199401291s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F63eNzovFha5jv7syk3XYzn1tqDgDwm68HpHd56cNJKAsFcoe): protocol: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44910->145.79.227.40:4069: use of closed network connection Jan 6 19:58:08.219057565 (772h29m48.199410201s) [noise=true , address=145.79.227.40:4069 , piece_id=7RMXA4M66ZXOHHKR5FCSHBVFWUZNE3G2JVT2QFIOLOXHJ2GT6OHQ, seg_pos={0 0}, upload=679912]: Long tail cancellation due to optimal threshold Jan 6 19:58:08.219089322 (772h29m48.199441949s) [seg_pos={0 0}, upload=679912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 6 19:58:08.219237200 (772h29m48.199589839s) [upload=679912]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:08.219244038 (772h29m48.199596674s) [upload=679912]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:08.352159986 (772h29m48.332512623s) [upload=679912]: Done uploading segments... Jan 6 19:58:08.352210140 (772h29m48.332562776s) [upload=679912]: Upload finished. err: <nil> Duration: 3.193432675s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.416386614s trace: https://jaeger.dev.storj.io/trace/6e0ed516680ebec8 FAIL (2026-01-06 20:26:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, Piece ID: 4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q) context deadline exceeded; piecestore: (Node ID: 121scLvKEW9zw2aEz22zpremcjiop67eQ8v2uqpmaD5aZzCAP7b, Piece ID: HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A) context deadline exceeded ======LOGS====== Jan 6 19:58:17.403555994 (772h29m57.383908645s) [upload=679917]: Starting upload Jan 6 19:58:17.403666206 (772h29m57.384018858s) [upload=679917]: Done starting upload Jan 6 19:58:17.403842502 (772h29m57.38419514s) [upload=679917]: Uploading segments... Jan 6 19:58:17.404166965 (772h29m57.384519606s) [upload=679917]: Got next segment. Inline: false Jan 6 19:58:17.404223968 (772h29m57.38457663s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 6 19:58:17.404230594 (772h29m57.384583235s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 6 19:58:17.516709204 (772h29m57.49706185s) [seg_pos={0 0}, upload=679917]: Begin upload segment... Jan 6 19:58:17.516795101 (772h29m57.497147747s) [seg_pos={0 0}, upload=679917]: Done begin upload segment. Jan 6 19:58:17.516832647 (772h29m57.497185292s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.517030264 (772h29m57.497382912s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518092013 (772h29m57.498444671s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.518958504 (772h29m57.49931115s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519239753 (772h29m57.4995924s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519449404 (772h29m57.499802051s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.519955276 (772h29m57.500307924s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520193176 (772h29m57.500545822s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.520785527 (772h29m57.501138173s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521208368 (772h29m57.501561018s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521330375 (772h29m57.501683021s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.521967075 (772h29m57.502319718s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522287136 (772h29m57.502639784s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.522546502 (772h29m57.502899148s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.523557905 (772h29m57.50391057s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:17.524586930 (772h29m57.504939577s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Uploading piece... Jan 6 19:58:18.166215094 (772h29m58.146567733s) [upload=679917]: Next returned nil segment Jan 6 19:58:18.166228823 (772h29m58.14658146s) [upload=679917]: Waiting for error group managing segments... Jan 6 19:58:18.302286606 (772h29m58.282639244s) [noise=true , address=77.90.31.11:4554 , piece_id=APVBHYAJTLHMGP43CYZH5GJI2WLU4B75VNOM23HAJDZXQKN52RBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.343646848 (772h29m58.323999484s) [noise=true , address=145.79.227.7:4294 , piece_id=4ASODFJ6D6DV7MOMS633CIPEXNZRTSGGMCNPXIW6EQYOYRZ7YB7Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.357722828 (772h29m58.338075467s) [noise=true , address=145.79.227.3:4149 , piece_id=WQTF2UFKP6F2WOCQRQRDOUGO2CKA5XM75RGMDGHLJXOPT5QE5GXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.367003674 (772h29m58.347356311s) [noise=true , address=145.79.227.21:4474 , piece_id=SRH43WGKHL4P6DSK6IEMIXCFWLGQB3LUB446TW5RSYPXVFHPGD4A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.376262781 (772h29m58.356615421s) [noise=true , address=145.79.227.51:4411 , piece_id=T3V2KXXU5RWNEL5PKZOLE52HWQ63EYVQEG5DIPQOKIPG4NB572EA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.403506818 (772h29m58.383859465s) [noise=true , address=45.91.116.13:4155 , piece_id=PSTDPHBFND4FY5QX2W6UEWRWWQNQKFDOI5EY5U3SV6PXYYIDINPA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.465404723 (772h29m58.445757372s) [noise=true , address=45.91.116.14:4190 , piece_id=YCIXPMM5W2S5MB7JMRZ4C6X52TTHKFU3JOR3GNKX47HMS2CLJPOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.567776867 (772h29m58.548129504s) [noise=true , address=145.79.227.50:4374 , piece_id=F7OF7WGKUV45AYBQV7VD4JWKAECXHXO25EMZFPTME7HO7L4ZPDBQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.599132864 (772h29m58.579485506s) [noise=true , address=145.79.227.22:4511 , piece_id=PPB74G37XMMLG6743DIU2ASUCHH4C3YFPTIKTDFTI6MOYVUJAWXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.613759829 (772h29m58.594112475s) [noise=true , address=145.79.227.39:4013 , piece_id=HMZ7HBXLP5WWXN6UATBJ5MYTLN3X6LE2O24UWSODROYXNKPAAS2A, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.664243429 (772h29m58.644596056s) [noise=true , address=145.79.227.8:4331 , piece_id=GOB5HGXBW3MGWNMITJWEJVEPS4LKBXUJCVJ3YEUEVORZIJ2CYS2Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:18.895647542 (772h29m58.876000181s) [noise=true , address=145.79.227.38:4978 , piece_id=R2ROZLP2S2SSQWILCC6ZKDBFFAEZRB326G4RIDTECJANC4HBMFXA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102892198 (772h29m59.08324489s) [noise=true , address=77.90.31.15:4697 , piece_id=ORJFXZE4C5N3HYURWP7ES6RICDAQOCFWTQQGAQL4CIJKETA4T4JA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: <nil> Jan 6 19:58:19.102980997 (772h29m59.083333641s) [seg_pos={0 0}, upload=679917]: Segment reached optimal threshold of 13 pieces. Jan 6 19:58:19.103439612 (772h29m59.083792261s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqSapYVaJiXrqqGfD9a1XFgf6Y8eGJXmudUmLhX7yjmYXBWTm): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.103456166 (772h29m59.083808814s) [noise=true , address=145.79.227.41:4086 , piece_id=JGT2SXDDBVFZY7ITAWWOUVKOJNRWPTKBOQCOTVETV6PLENMM7WOQ, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.103732510 (772h29m59.084085155s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50926->77.90.31.18:4805: use of closed network connection Jan 6 19:58:19.103739973 (772h29m59.084092617s) [noise=true , address=77.90.31.18:4805 , piece_id=YURVZENWQ7A4XXCHBBUW2EIB33MJHTREXENTIXEAM7ODIXP5DT4Q, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104075008 (772h29m59.084427655s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mNCKAdMzWu87fmyrcwDKZvscMcu2CogjXicwAi5wLSFJa7oVV): protocol: expected piece hash; context canceled; EOF Jan 6 19:58:19.104083229 (772h29m59.08443587s) [noise=true , address=145.79.227.35:4482 , piece_id=O5SVWJCLHAMEKCNVTZHCQQS32N6LDHGUWZ2J4WPIRLNW47RXMKBA, seg_pos={0 0}, upload=679917]: Long tail cancellation due to optimal threshold Jan 6 19:58:19.104103417 (772h29m59.084456044s) [seg_pos={0 0}, upload=679917]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 6 19:58:19.104195361 (772h29m59.084548002s) [upload=679917]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 6 19:58:19.104203262 (772h29m59.08455589s) [upload=679917]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 6 19:58:19.248322143 (772h29m59.228674781s) [upload=679917]: Done uploading segments... Jan 6 19:58:19.248344948 (772h29m59.228697584s) [upload=679917]: Upload finished. err: <nil> Duration: 2.416525783s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)