Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
431.213964ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:54:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 431.243254ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X...X.................................] duration:
1.142284398s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:54:25 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.142319331s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
442.797064ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:54:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 442.825563ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................XX..................................] duration:
199.558603ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:54:04 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 199.655675ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
914.170974ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:53:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 914.203ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................XX.................................] duration:
153.673069ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:53:41 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 153.768174ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...X................................] duration:
884.284818ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:53:27 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 884.313802ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................XX................................] duration:
164.518958ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:52:45 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 164.548103ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X...X...............................] duration:
1.056350311s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:52:42 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.05637541s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
901.399449ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:52:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 901.420656ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
953.466759ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:52:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 953.508768ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................XX...............................] duration:
128.014115ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:51:40 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 128.110691ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X...X..............................] duration:
1.514835041s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:51:37 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.514867631s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................XX..............................] duration:
154.087184ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:51:07 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 154.117355ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
502.459201ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:51:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 502.48261ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X...X.............................] duration:
1.287605464s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:51:02 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.28764426s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................XX.............................] duration:
179.996733ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:50:49 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 180.023181ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
945.501457ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:50:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 945.534184ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X...X............................] duration:
918.153605ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:49:56 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 918.179017ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................XX............................] duration:
124.901686ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:49:48 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 124.929159ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................XX...........................] duration:
177.51861ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:49:29 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 177.553792ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
899.207707ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:49:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 899.251192ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X...X...........................] duration:
985.232998ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:49:17 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 985.305915ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................XX..........................] duration:
184.522299ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:49:03 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 184.647444ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X...X..........................] duration:
1.073458714s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:49:00 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.073491967s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
864.123646ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:48:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 864.147692ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X...X.........................] duration:
1.33905762s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:48:43 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.33909195s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................XX.........................] duration:
122.793993ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:48:07 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 122.82067ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
435.658556ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:47:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 435.85224ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X...X........................] duration:
859.321158ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:47:37 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 859.352822ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................XX........................] duration:
156.510495ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:47:18 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 156.538558ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
406.698605ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:46:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 406.720786ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X...X.......................] duration:
1.014174855s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:46:52 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.014209251s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X...X......................] duration:
1.306470177s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:46:36 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.306510553s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................XX.......................] duration:
157.500891ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:46:25 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 157.525978ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
450.7861ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:46:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 450.815511ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X...X.....................] duration:
1.384260451s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:46:04 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.384293379s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................XX......................] duration:
156.783611ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:45:45 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 156.810892ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
553.797379ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:45:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 553.869252ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X...X....................] duration:
1.154520474s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:44:50 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.154569517s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration:
156.335053ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:44:41 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 156.380077ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
488.350605ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:44:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 488.418329ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X...X...................] duration:
937.041212ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:44:00 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 937.071998ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X...X..................] duration:
879.576847ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:43:44 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 879.610575ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................XX....................] duration:
142.058185ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:43:34 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 142.097518ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X...X.................] duration:
958.225581ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:43:02 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 958.319036ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
446.283479ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:42:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 446.367392ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................XX...................] duration:
139.710048ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:42:35 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 139.738605ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
394.635624ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:42:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 394.684457ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X...X................] duration:
1.056023607s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:42:25 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.056053745s
core
uplink
eu1
|