Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........XX...............................................] duration:
333.053093ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 04:06:00 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 333.08519ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
441.994661ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 04:05:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 442.034822ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [............XX..............................................] duration:
219.259195ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 04:05:27 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 219.2913ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X...X...............................................] duration:
1.347889947s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 04:05:23 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.347946473s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X...X..............................................] duration:
1.032732259s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 04:05:04 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.032781092s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
932.583394ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 04:04:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 932.602441ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............XX.............................................] duration:
167.882097ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 04:04:28 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 167.91548ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X...X.............................................] duration:
971.248948ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 04:04:09 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 971.335509ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
950.527258ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 04:04:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 950.71863ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
1.085145081s trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 04:03:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 1.08519078s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............XX............................................] duration:
146.819053ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 04:03:28 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 146.848529ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X...X............................................] duration:
791.712784ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 04:03:14 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 791.739481ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............XX...........................................] duration:
132.931159ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 04:02:37 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 132.957779ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X...X...........................................] duration:
1.220557261s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 04:02:28 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.220581661s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
435.565508ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 04:02:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 435.592785ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
938.200266ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 04:01:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 938.226309ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [................XX..........................................] duration:
150.279947ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 04:01:26 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 150.30938ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X...X..........................................] duration:
1.214763807s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 04:01:20 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.214793659s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
419.100352ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 04:00:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 419.133234ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................XX.........................................] duration:
177.77843ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 04:00:27 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 177.810348ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X...X.........................................] duration:
878.400319ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 04:00:26 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 878.433122ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X...X........................................] duration:
1.072051175s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 04:00:04 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.072087472s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
439.827091ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:59:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 439.913915ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
844.502538ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:59:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 844.53014ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................XX........................................] duration:
152.29597ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:59:25 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 152.393453ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X...X.......................................] duration:
1.146681394s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:59:13 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.146709435s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................XX.......................................] duration:
138.493669ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:58:54 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 138.523321ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
460.773406ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:58:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 460.802492ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X...X......................................] duration:
1.05779634s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:58:43 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.057824057s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
1.000886167s trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:58:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 1.000918548s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................XX......................................] duration:
139.290958ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:58:04 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 139.317481ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X...X.....................................] duration:
1.144953195s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:57:31 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.144988386s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................XX.....................................] duration:
161.414144ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:57:09 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 161.439059ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
940.014499ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:56:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 940.040413ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X...X....................................] duration:
1.097802242s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:56:17 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.09784121s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................XX....................................] duration:
184.067061ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:55:56 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 184.097715ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X...X...................................] duration:
968.507584ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:55:54 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 968.535209ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
430.423707ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:55:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 430.454562ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................XX...................................] duration:
136.83838ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:55:19 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 136.866805ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...X..................................] duration:
869.703264ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:55:10 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 869.744373ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
431.213964ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:54:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 431.243254ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X...X.................................] duration:
1.142284398s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:54:25 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.142319331s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
442.797064ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:54:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 442.825563ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................XX..................................] duration:
199.558603ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:54:04 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 199.655675ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
914.170974ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:53:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 914.203ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................XX.................................] duration:
153.673069ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:53:41 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 153.768174ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...X................................] duration:
884.284818ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:53:27 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 884.313802ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................XX................................] duration:
164.518958ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:52:45 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 164.548103ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X...X...............................] duration:
1.056350311s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:52:42 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.05637541s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
901.399449ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:52:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 901.420656ms
core
uplink
eu-select-1
eu1-placement-15
|