Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................XX..................] duration:
145.296284ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:42:10 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 145.326331ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
397.188744ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:41:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 397.216912ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X...X...............] duration:
965.084797ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:41:17 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 965.120834ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................XX.................] duration:
127.193396ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:41:08 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 127.221896ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
457.053739ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:40:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 457.079994ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X...X..............] duration:
988.63596ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:40:07 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 988.666056ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................XX................] duration:
165.681327ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:40:05 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 165.710893ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
417.407062ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:39:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 417.442754ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X...X.............] duration:
1.013974284s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:39:12 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.01408335s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................XX...............] duration:
167.627293ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:38:54 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 167.686612ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X...X............] duration:
1.129280758s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:38:35 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.129313831s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................................X...X...........] duration:
859.38743ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:38:14 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 859.413836ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
426.725441ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:38:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 426.751501ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................................XX..............] duration:
141.378935ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:37:50 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 141.402303ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
394.605006ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:37:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 394.68348ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X...X..........] duration:
1.408690876s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:37:17 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.408722257s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X...X.........] duration:
1.13476681s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:36:59 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.134798971s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
503.70525ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:36:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 503.734179ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................................XX.............] duration:
131.900452ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:36:36 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 131.935552ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
498.588294ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:36:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 498.624226ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................................XX............] duration:
138.435587ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:35:52 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 138.531491ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X...X........] duration:
1.030924978s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:35:45 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.030949044s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................................XX...........] duration:
170.864524ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:35:32 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 170.892648ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
455.112342ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:35:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 455.184369ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................................XX..........] duration:
118.645032ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:34:33 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 118.67987ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................................X...X.......] duration:
902.502024ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:34:31 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 902.534993ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
425.958753ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:34:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 425.98587ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................................XX.........] duration:
138.701767ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:34:09 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 138.759245ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X...X......] duration:
1.066119301s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:33:51 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.066144333s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X...X.....] duration:
1.158665875s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:33:25 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.158693499s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
471.289212ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:33:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 471.319041ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................................XX........] duration:
146.357917ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:32:58 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 146.400307ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X...X....] duration:
1.272545249s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:32:55 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.27257622s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
928.870686ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:32:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 928.904112ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................................XX.......] duration:
136.657365ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:32:21 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 136.687912ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................................X...X...] duration:
967.117251ms trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:32:17 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 967.146147ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................X...X..] duration:
1.143879462s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:31:31 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.143904207s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................................XX......] duration:
138.808231ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:31:28 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 138.842591ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
426.51501ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:31:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 426.615239ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................................X...X.] duration:
1.123330877s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:30:56 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.123351486s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................X...X] duration:
30.005123956s trace:
https://jaeger.dev.storj.io/trace/1abf79eb2f5524b8
FAIL (2026-01-07 03:30:54 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 30.005153718s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
414.124871ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:30:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 414.157555ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................XX.....] duration:
169.740391ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:30:34 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 169.770351ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
474.74375ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:30:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 474.776943ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.405766038s trace:
https://jaeger.dev.storj.io/trace/1418f9f06900bf6f
FAIL (2026-01-07 03:29:54 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 1.4057986s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
436.226017ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:29:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 436.254552ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................................XX....] duration:
145.548956ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:29:38 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 145.578705ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
871.323058ms trace:
https://jaeger.dev.storj.io/trace/7b371892eef4dd63
FAIL (2026-01-07 03:29:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
uplink: metainfo: metaclient: context deadline exceeded
======LOGS======
, upload=686441]: Uploading piece...
Jan 7 03:26:43.387872805 (779h58m23.368225447s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389178235 (779h58m23.369530882s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.389739604 (779h58m23.370092243s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390234914 (779h58m23.370587552s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390479507 (779h58m23.370832149s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.390725806 (779h58m23.371078448s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391155258 (779h58m23.371507903s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.391639750 (779h58m23.371992392s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392116840 (779h58m23.372469479s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.392750335 (779h58m23.373102981s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Uploading piece...
Jan 7 03:26:43.500488982 (779h58m23.480841619s) [upload=686441]: Next returned nil segment
Jan 7 03:26:43.500502704 (779h58m23.480855344s) [upload=686441]: Waiting for error group managing segments...
Jan 7 03:26:43.519244889 (779h58m23.499597525s) [noise=true , address=89.149.201.147:4009 , piece_id=OIA5BFYG3T3Q562VX7DSN325RRQVO2LCTKOWMSMU7CNYSLSYKIHQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.521603031 (779h58m23.501955672s) [noise=true , address=89.149.201.147:4015 , piece_id=7XWP6ZCNJ4Y76PFLX3X4HCJ4FLQUKNPIFBUIFL5AZZHF5TNGXJSA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522270327 (779h58m23.502622973s) [noise=true , address=81.171.14.70:4026 , piece_id=D6V7S54H3EHP7OGPZ5QXLL7BTFINC2WXI62SO7JOOQA3DY4AMDLA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.522813706 (779h58m23.503166363s) [noise=true , address=81.171.14.70:4035 , piece_id=WTUPVS7JQZMTPBY6BZDFOFHPX26Y7MZO6BCGYOIQDZJHWWMSYLXQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523516032 (779h58m23.503868675s) [noise=true , address=89.149.201.147:4004 , piece_id=ZFRSJDEEINM7XYDXLVEA44IMJPY5L3CCZ7DNDY5YYXVOP3QIXECQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.523730457 (779h58m23.5040831s) [noise=true , address=81.171.14.70:4043 , piece_id=OOIX4QERWXDD3NLKOKT6JKNTQJ2QDT7Z7C25TME277PUSVINLUWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.529666198 (779h58m23.510018838s) [noise=true , address=81.171.14.70:4039 , piece_id=WJYTHK6LCJXQ5OHFVUAHJD5A4YG3ZRABHKLICBAFBQ4ELNDN24KQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531785009 (779h58m23.512137648s) [noise=true , address=185.167.204.205:4010 , piece_id=JIUNU2MQONHWOCZHMHYP6U7II55LAN3QZOGHGFV6C5UGNNN7WN3Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.531964414 (779h58m23.512317053s) [noise=true , address=185.167.204.205:4023 , piece_id=ZHIVHZ57WMZVXMB6WR3DE7AR5DTTPOCUTFUYRR2UX6Y34MDHAZ4Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.533351952 (779h58m23.513704592s) [noise=true , address=185.167.204.205:4019 , piece_id=KFCI6QHNYKKMSPTCW3UHLW4BAGEMJ4UW3533O3E5E5IEWFWLJIGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.534306412 (779h58m23.514659034s) [noise=true , address=185.167.204.206:4066 , piece_id=BSNLFLDRXJOULSYRIID5TLRWMYHTWTCW3WOLRUUV5MTULNCQOI4A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.535288465 (779h58m23.515641105s) [noise=true , address=81.171.14.70:4046 , piece_id=WOOFVSQOIVEYUBACZ5VB25OTVAQQOIOVNTIM3454DMIKM265PC5Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537352031 (779h58m23.517704654s) [noise=true , address=185.167.204.206:4067 , piece_id=ZCWEF6EMT2FOUKDXANWL3JL4MUF3GHU2W7TRP4DN2A5ODXIQ5GTA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537498734 (779h58m23.517851373s) [noise=true , address=89.149.201.147:4001 , piece_id=MG6CMDYJ2YMJXJESV5VEMIH7LBQDM76GDCPAWDBVRUA2FQJIGKGQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.537897241 (779h58m23.518249877s) [noise=true , address=81.171.14.70:4044 , piece_id=WGKLEZ5XR24VULXUHGXCBWFQYCJZYAOMY5SSMGQVZCLUNBFB2F6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538034385 (779h58m23.518387007s) [noise=true , address=185.167.204.205:4033 , piece_id=NEZLBBZB5LX4AXIE7H4BCK3KNQVAE33F2TUXDSRAJH3YVSWAQC6A, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.538323050 (779h58m23.51867569s) [noise=true , address=185.167.204.206:4038 , piece_id=OIMOMB7DTTLRNEUN2CNIH3EDBRSKTBZBBW6Y2YVJ2MSUIXQUOBWA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541534619 (779h58m23.521887242s) [noise=true , address=185.167.204.206:4054 , piece_id=OOVZMXJSWKCWSUX344RRDG7UEZEAOMQXUG6OV5VXESSJWGWRB2UA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.541641818 (779h58m23.521994457s) [noise=true , address=89.149.201.147:4002 , piece_id=SSYLTLUQ4FQF6PGLTSTKPJ5IZRQJ4E54VHGD7GXJK62HEBRTO76Q, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.542927272 (779h58m23.523279912s) [noise=true , address=81.171.14.70:4034 , piece_id=CDJTQ4VXBYZZ2LOC67NSP4UE32UNKHXJV2MDMZUWUD7555NHIQZA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.548025411 (779h58m23.528378057s) [noise=true , address=185.167.204.205:4006 , piece_id=MHY77DOTEOQ3GJAKT4XAPI4T26UPVA4V7GOHP4VXE7XELXWZCBJQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549020976 (779h58m23.529373612s) [noise=true , address=185.167.204.205:4013 , piece_id=PMPDCCOHXJDWJKHW5FEHPFRGMGCPMVGNDV65GJY73E7KVXTLEJKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.549553037 (779h58m23.529905673s) [noise=true , address=185.167.204.206:4060 , piece_id=EGSWBQO6LPILNP5DCG5B2NRTAFODYQLXQNPIWA53PMMMYFBL7FPA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.553488022 (779h58m23.533840671s) [noise=true , address=89.149.201.147:4018 , piece_id=NQSTC75YLUXJMXORNC5Y3HD344Q65BAEEYLKLMG4H5AFLQSVB7YQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.560492616 (779h58m23.540845257s) [noise=true , address=185.167.204.205:4021 , piece_id=JIGFGKA2MDSOU4B5K6NSQBVC25AP5BV7O3HWVFEGT3CN6AKZODQQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577759518 (779h58m23.558112158s) [noise=true , address=185.167.204.206:4070 , piece_id=N4WYS4MR4AJANFYA4M23HZQBFTZD4AGDDYLXU6XPK7GHSAOX4OKA, seg_pos={0 0}, upload=686441]: Done uploading piece. err: <nil>
Jan 7 03:26:43.577785998 (779h58m23.55813862s) [seg_pos={0 0}, upload=686441]: Segment reached optimal threshold of 26 pieces.
Jan 7 03:26:43.578144391 (779h58m23.558497039s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578155754 (779h58m23.558508401s) [noise=true , address=81.171.14.70:4037 , piece_id=2FG5V4FO6DQ2SW2654GQ7QNHNFVACXHBZ4H6YCAAWGDGNPLUJQKQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578572099 (779h58m23.558924744s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU): protocol: expected piece hash; context canceled; EOF
Jan 7 03:26:43.578582539 (779h58m23.558935183s) [noise=true , address=81.171.14.70:4025 , piece_id=FBE46UULDT5THRXYPUNWLIEAGC4WMXOZP65J3ERVKVJPLTVAMKCQ, seg_pos={0 0}, upload=686441]: Long tail cancellation due to optimal threshold
Jan 7 03:26:43.578616418 (779h58m23.558969042s) [seg_pos={0 0}, upload=686441]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Jan 7 03:26:43.578719775 (779h58m23.559072419s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 7 03:26:43.578727146 (779h58m23.55907979s) [upload=686441]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 7 03:26:43.611283195 (779h58m23.591635841s) [upload=686441]: Done uploading segments...
Jan 7 03:26:43.611442487 (779h58m23.591795129s) [upload=686441]: Upload finished. err: <nil>
Duration: 871.352579ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.079907196s trace:
https://jaeger.dev.storj.io/trace/1418f9f06900bf6f
FAIL (2026-01-07 03:28:56 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 1.079936859s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................XX...] duration:
146.211353ms trace:
https://jaeger.dev.storj.io/trace/4b8a4595fd3a13
FAIL (2026-01-07 03:28:24 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 146.241316ms
core
uplink
eu1
|