Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
520.526136ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:30:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 520.624235ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
460.820809ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:29:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 460.852516ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
490.556583ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:28:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 490.584762ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
600.842059ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:27:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 600.936345ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
422.300346ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:25:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 422.387041ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
500.290223ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:24:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 500.317894ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
473.642781ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:23:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 473.673633ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
976.974646ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:22:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 977.001354ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
510.151277ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:22:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 510.179756ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
585.037374ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:22:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 585.068279ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
898.022892ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:21:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 898.043835ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
496.136534ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:21:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 496.246127ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
910.719335ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:20:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 910.812138ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
427.02927ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:19:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 427.060656ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
571.193597ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:19:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 571.282315ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
476.3831ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:18:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 476.416548ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
554.966318ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:17:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 554.999886ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
493.061813ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:16:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 493.171486ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
531.525493ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:16:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 531.552534ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
885.579322ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:15:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 885.612375ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
449.993572ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:14:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 450.128154ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
478.201538ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:13:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 478.244386ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
840.569748ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:12:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 840.599694ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
616.294959ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:11:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 616.331417ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
448.14834ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:10:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 448.178031ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
565.777354ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:09:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 565.805539ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
535.685042ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:08:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 535.718603ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
943.348158ms trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:07:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 943.378924ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.020196146s trace:
https://jaeger.dev.storj.io/trace/5b402317f5475019
FAIL (2026-01-27 09:07:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ddress=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999698137 (281h11m18.883652339s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:40.999924473 (281h11m18.883878676s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000201248 (281h11m18.884155448s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.000638208 (281h11m18.884592407s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001106008 (281h11m18.885060207s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001567664 (281h11m18.885521862s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.001998976 (281h11m18.885953306s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.002452840 (281h11m18.886407041s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003030602 (281h11m18.886984801s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.003563617 (281h11m18.887517815s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.004126294 (281h11m18.888080504s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Uploading piece...
Jan 27 09:06:41.111775107 (281h11m18.995729292s) [upload=247414]: Next returned nil segment
Jan 27 09:06:41.111789753 (281h11m18.995743953s) [upload=247414]: Waiting for error group managing segments...
Jan 27 09:06:41.126247549 (281h11m19.010201749s) [noise=true , address=89.149.201.147:4005 , piece_id=VJWSGGV4EA7FRW3PDTEP5F3HBS53OIMDMXV6RPXH33UUIORNYYYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.128941871 (281h11m19.012896069s) [noise=true , address=81.171.14.70:4038 , piece_id=IZAKGV245RH4XEVFEWKBQHGH6SL46SZBAK66TZDLMX42FQ3XQOGA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.130253611 (281h11m19.01420781s) [noise=true , address=81.171.14.70:4046 , piece_id=JJX2LABIMP2KNXAE2VV7T7PKZHKBBOE6PFQNFA2R677JXKI6RC4A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136034098 (281h11m19.019988297s) [noise=true , address=89.149.201.147:4002 , piece_id=QMGMNYEPPADIKBM7YNA3VMGVCGIVLIIJSVCZEQ7NJH4YTRU57EZA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.136554954 (281h11m19.020509153s) [noise=true , address=89.149.201.147:4008 , piece_id=VZPJ3RFOAE3FK7BQZAYPVRSSY56HNBW6MLGFC2ZGB6FVGZZ2ECXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.139391978 (281h11m19.023349951s) [noise=true , address=81.171.14.70:4042 , piece_id=SK67WSG5QYSC3ECKRXR4VHGAT3MBNHRXCKHUEWA65LKNCHXGWHXA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141611386 (281h11m19.02556559s) [noise=true , address=89.149.201.147:4015 , piece_id=SIVKU2TRAIZGJYDG425WRR6TI2QZYNSYGISCBO3WJSOH4ZKTLVDQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.141722081 (281h11m19.02567629s) [noise=true , address=81.171.14.70:4030 , piece_id=KNJH5ZDK4FBEV6YMMV6OE2WAFT2LAAPHYVJR42BUCSBBM2YVTVAA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143192095 (281h11m19.027146294s) [noise=true , address=89.149.201.147:4023 , piece_id=5H4LXUYSEOTMRCZNJ6K3XM6NJDI7M4H2ME6S7VOVWZSWSWLETW2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143251878 (281h11m19.02720608s) [noise=true , address=185.167.204.205:4026 , piece_id=ZDQRG3KJ4V55HN7CAULYE2SBRMTOF37N6UWXPFHWYBKH44DIXNMA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.143874324 (281h11m19.027828527s) [noise=true , address=185.167.204.206:4049 , piece_id=POPRQUJQGNTQOT733VRYPHCND5PL2KKSLDGR6CF3VUUUUVJTVNTA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.146030094 (281h11m19.029984296s) [noise=true , address=81.171.14.70:4043 , piece_id=VIBRSCPY5O4TN3YF6QMX6K5RPSI7EKUDZENIDCMKPGKY2NB6GSLA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.147422016 (281h11m19.031376215s) [noise=true , address=89.149.201.147:4007 , piece_id=5MCWOTUB3NYM246SAXEXHGSRCAM5D5FJPMW3UGL2FKF5ZR6CV2SQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.149063165 (281h11m19.033017354s) [noise=true , address=185.167.204.205:4033 , piece_id=3CU7QU6YJQWIKJM3TICCG6GSK42ST23FRN5KGDDHJPUP5FPHJ45Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.151586125 (281h11m19.035540324s) [noise=true , address=185.167.204.206:4041 , piece_id=NRKSGIVJKO73TM6S74NX3LVVWLFFEZAK3JDPTAED6AAP4LWY6ICQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.152782074 (281h11m19.036736274s) [noise=true , address=185.167.204.206:4072 , piece_id=WWGB43R5YF6AE534XEIUCUDL6YSKQD4BN2FJJOAYWS32OBVGFH2A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.154754572 (281h11m19.038708766s) [noise=true , address=89.149.201.147:4014 , piece_id=NYP32SW5KAIPJR54YT6JTIDNA3TEELOTWW2F5VC6VDNWPJ4SFR5A, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159616545 (281h11m19.043570755s) [noise=true , address=185.167.204.205:4032 , piece_id=W2JNFYY6UAHQWTG35FXOYFLMRMNVVHVUPARTGJX4I2K6B2TBTRIA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.159647905 (281h11m19.043602105s) [noise=true , address=185.167.204.206:4048 , piece_id=IGFDKCJOHH2F4EYC4FQVXWMAU46QYISX6ICP2EKBYENHC7LWFPOA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.162452744 (281h11m19.046406935s) [noise=true , address=185.167.204.205:4028 , piece_id=IS4J7JPNXVRLM6A2QBPKWR5M3FPXAHK4XGTN3V4OV5ARQNORRHQQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.169459797 (281h11m19.053413997s) [noise=true , address=81.171.14.70:4031 , piece_id=HJMAMBDXH6EMPUXHN5GMSQ6HR4SJUVBB3EX2U3IIOD54RVNGPSYQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.184667753 (281h11m19.068621952s) [noise=true , address=185.167.204.205:4016 , piece_id=J7UML5JANZIXCTJBCTZ7FBHKU46MR3U6PLDLP47WZNI4FWUQ7Q6Q, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.185305030 (281h11m19.069259232s) [noise=true , address=185.167.204.205:4009 , piece_id=PSTB5VZJ7CR64H3ZARKQSR3HMRLHUTWATDO54AMCVFXACEG6CMFA, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.202256151 (281h11m19.08621035s) [noise=true , address=185.167.204.205:4003 , piece_id=33LD3SP56QAE3TKJBQRFESYAI2YO4AZATPVHL5BR6R7KNEO4RKBQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:06:41.696913017 (281h11m19.580867224s) [noise=true , address=89.149.201.147:4001 , piece_id=TZG4WFDCTII4MKKXW443OAW27B43SANJW6APV6SUWO65HREMJBZQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: <nil>
Jan 27 09:07:40.955345307 (281h12m18.839299512s) [noise=true , address=185.167.204.205:4021 , piece_id=PMFWH5FC3Y2I6DSVGSUXALCLTJX56FBBSWX3ECXKGPHVEFNEJGOQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 139.59.144.22:50072->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955429943 (281h12m18.839384148s) [noise=true , address=185.167.204.205:4023 , piece_id=FSJTO7SGRZN3X7ULEKRDTG3MREWR6LLFOMBPZLRTXTTSPKL7O2KQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 139.59.144.22:51444->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955533593 (281h12m18.839487798s) [noise=true , address=185.167.204.205:4018 , piece_id=BTLYXGSCQ2PBDKCQIY4SJ4DK6WZCKEHODI7X6D3FUYNFGXHT3ZUQ, seg_pos={0 0}, upload=247414]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 139.59.144.22:54990->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 27 09:07:40.955562397 (281h12m18.839516588s) [seg_pos={0 0}, upload=247414]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 27 09:07:40.971785044 (281h12m18.855739293s) [upload=247414]: Done uploading segments...
Jan 27 09:07:40.972120515 (281h12m18.856074714s) [upload=247414]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 1m0.020271458s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
2.179302614s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:22:29 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.179345809s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
1.681826256s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:21:33 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.681856656s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
1.995331273s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:20:39 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.995361352s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
1.632422042s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:20:06 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.632463469s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
1.689225961s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:19:28 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.689258589s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
1.511251696s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:18:51 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.511285036s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
1.637529838s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:17:48 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.637564895s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
1.719205756s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:17:04 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.719233575s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
2.166286779s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:16:23 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.166317052s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
1.738654222s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:15:34 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.739202327s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
1.702200824s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:14:58 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.702224931s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................] duration:
1.506067738s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:13:48 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.506095502s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................] duration:
1.598968384s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:13:19 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.599061522s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................] duration:
1.729656472s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:13:02 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.729693275s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
2.241372935s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:12:32 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.241400483s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
1.594756043s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:11:49 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.594822157s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
1.676966336s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:11:09 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.677005295s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
2.107295778s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:10:54 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.107347484s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
1.688957932s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:10:33 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.688987498s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
1.527474968s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:09:42 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.527526452s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................] duration:
1.658143749s trace:
https://jaeger.dev.storj.io/trace/50976b0dbd7d0d8f
FAIL (2026-01-27 01:08:57 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.658176203s
core
uplink
us-select-1
us1-placement-20
|