Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X....X...................X.........X.........X.] duration:
6.302686893s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:47:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 6.302715906s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............X....X...................X.........X.........X] duration:
30.114546074s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:47:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 30.11463843s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............X....X...................X.........X.........] duration:
2.40393774s trace:
https://jaeger.dev.storj.io/trace/16f950045d00ca2c
FAIL (2026-02-06 14:46:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
eb 6 14:38:54.350721185 (526h43m32.234675389s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 14:38:54.350729375 (526h43m32.234683581s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 14:38:54.475554624 (526h43m32.359508823s) [seg_pos={0 0}, upload=463520]: Begin upload segment...
Feb 6 14:38:54.475621377 (526h43m32.359575576s) [seg_pos={0 0}, upload=463520]: Done begin upload segment.
Feb 6 14:38:54.475680834 (526h43m32.359635044s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.475716875 (526h43m32.359671084s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476416919 (526h43m32.360371129s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476994579 (526h43m32.360948786s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477136209 (526h43m32.361090412s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477688450 (526h43m32.361642659s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478260029 (526h43m32.362214238s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478385545 (526h43m32.362339738s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478800615 (526h43m32.362754822s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478816417 (526h43m32.36277062s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479234796 (526h43m32.363188985s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479399113 (526h43m32.363353352s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479638578 (526h43m32.36359278s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480003360 (526h43m32.363957572s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480564500 (526h43m32.364518707s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.482868054 (526h43m32.366822245s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:55.083498782 (526h43m32.967452989s) [upload=463520]: Next returned nil segment
Feb 6 14:38:55.083518072 (526h43m32.967472282s) [upload=463520]: Waiting for error group managing segments...
Feb 6 14:38:55.220887662 (526h43m33.104841863s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.221767546 (526h43m33.105721749s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.223626184 (526h43m33.107580389s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233117516 (526h43m33.117071715s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233574826 (526h43m33.117529028s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233869860 (526h43m33.117824063s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.236556731 (526h43m33.120510933s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237718058 (526h43m33.121672268s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237994236 (526h43m33.121948436s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:39:24.043453190 (526h44m1.927407397s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection
Feb 6 14:39:24.043494413 (526h44m1.927448641s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:39:24.043598366 (526h44m1.927552569s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection
Feb 6 14:39:24.043690919 (526h44m1.927645127s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12EpaUWUm3s5S4B3tN4KSFtWKafwHMv5rehKqzPkfFv7JmcYR46, address:79.127.219.45:4854): protocol: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection
Feb 6 14:39:24.043862961 (526h44m1.927817164s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 139.59.144.22:45966->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044055077 (526h44m1.928009282s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:48288->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044343069 (526h44m1.928297278s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1AFb6pwh2crCNjT7W7WU7dtd825DP1db64Gy2HkthZG3M46J8C, address:79.127.219.46:4890): protocol: read tcp 139.59.144.22:41962->79.127.219.46:4890: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044392088 (526h44m1.928346278s) [seg_pos={0 0}, upload=463520]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Feb 6 14:39:24.156254636 (526h44m2.040208853s) [upload=463520]: Done uploading segments...
Feb 6 14:39:24.156301646 (526h44m2.040255862s) [upload=463520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 2.403969073s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.3601035s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:45:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.360136187s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.405788501s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:45:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.405817161s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [................X....X...................X.........X........] duration:
2.633032966s trace:
https://jaeger.dev.storj.io/trace/16f950045d00ca2c
FAIL (2026-02-06 14:45:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
eb 6 14:38:54.350721185 (526h43m32.234675389s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 14:38:54.350729375 (526h43m32.234683581s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 14:38:54.475554624 (526h43m32.359508823s) [seg_pos={0 0}, upload=463520]: Begin upload segment...
Feb 6 14:38:54.475621377 (526h43m32.359575576s) [seg_pos={0 0}, upload=463520]: Done begin upload segment.
Feb 6 14:38:54.475680834 (526h43m32.359635044s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.475716875 (526h43m32.359671084s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476416919 (526h43m32.360371129s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476994579 (526h43m32.360948786s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477136209 (526h43m32.361090412s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477688450 (526h43m32.361642659s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478260029 (526h43m32.362214238s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478385545 (526h43m32.362339738s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478800615 (526h43m32.362754822s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478816417 (526h43m32.36277062s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479234796 (526h43m32.363188985s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479399113 (526h43m32.363353352s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479638578 (526h43m32.36359278s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480003360 (526h43m32.363957572s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480564500 (526h43m32.364518707s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.482868054 (526h43m32.366822245s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:55.083498782 (526h43m32.967452989s) [upload=463520]: Next returned nil segment
Feb 6 14:38:55.083518072 (526h43m32.967472282s) [upload=463520]: Waiting for error group managing segments...
Feb 6 14:38:55.220887662 (526h43m33.104841863s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.221767546 (526h43m33.105721749s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.223626184 (526h43m33.107580389s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233117516 (526h43m33.117071715s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233574826 (526h43m33.117529028s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233869860 (526h43m33.117824063s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.236556731 (526h43m33.120510933s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237718058 (526h43m33.121672268s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237994236 (526h43m33.121948436s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:39:24.043453190 (526h44m1.927407397s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection
Feb 6 14:39:24.043494413 (526h44m1.927448641s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:39:24.043598366 (526h44m1.927552569s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection
Feb 6 14:39:24.043690919 (526h44m1.927645127s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12EpaUWUm3s5S4B3tN4KSFtWKafwHMv5rehKqzPkfFv7JmcYR46, address:79.127.219.45:4854): protocol: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection
Feb 6 14:39:24.043862961 (526h44m1.927817164s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 139.59.144.22:45966->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044055077 (526h44m1.928009282s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:48288->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044343069 (526h44m1.928297278s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1AFb6pwh2crCNjT7W7WU7dtd825DP1db64Gy2HkthZG3M46J8C, address:79.127.219.46:4890): protocol: read tcp 139.59.144.22:41962->79.127.219.46:4890: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044392088 (526h44m1.928346278s) [seg_pos={0 0}, upload=463520]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Feb 6 14:39:24.156254636 (526h44m2.040208853s) [upload=463520]: Done uploading segments...
Feb 6 14:39:24.156301646 (526h44m2.040255862s) [upload=463520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 2.633128994s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................X....X...................X.........X.......] duration:
2.376806935s trace:
https://jaeger.dev.storj.io/trace/16f950045d00ca2c
FAIL (2026-02-06 14:44:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
eb 6 14:38:54.350721185 (526h43m32.234675389s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 14:38:54.350729375 (526h43m32.234683581s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 14:38:54.475554624 (526h43m32.359508823s) [seg_pos={0 0}, upload=463520]: Begin upload segment...
Feb 6 14:38:54.475621377 (526h43m32.359575576s) [seg_pos={0 0}, upload=463520]: Done begin upload segment.
Feb 6 14:38:54.475680834 (526h43m32.359635044s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.475716875 (526h43m32.359671084s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476416919 (526h43m32.360371129s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476994579 (526h43m32.360948786s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477136209 (526h43m32.361090412s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477688450 (526h43m32.361642659s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478260029 (526h43m32.362214238s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478385545 (526h43m32.362339738s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478800615 (526h43m32.362754822s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478816417 (526h43m32.36277062s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479234796 (526h43m32.363188985s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479399113 (526h43m32.363353352s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479638578 (526h43m32.36359278s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480003360 (526h43m32.363957572s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480564500 (526h43m32.364518707s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.482868054 (526h43m32.366822245s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:55.083498782 (526h43m32.967452989s) [upload=463520]: Next returned nil segment
Feb 6 14:38:55.083518072 (526h43m32.967472282s) [upload=463520]: Waiting for error group managing segments...
Feb 6 14:38:55.220887662 (526h43m33.104841863s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.221767546 (526h43m33.105721749s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.223626184 (526h43m33.107580389s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233117516 (526h43m33.117071715s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233574826 (526h43m33.117529028s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233869860 (526h43m33.117824063s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.236556731 (526h43m33.120510933s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237718058 (526h43m33.121672268s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237994236 (526h43m33.121948436s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:39:24.043453190 (526h44m1.927407397s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection
Feb 6 14:39:24.043494413 (526h44m1.927448641s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:39:24.043598366 (526h44m1.927552569s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection
Feb 6 14:39:24.043690919 (526h44m1.927645127s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12EpaUWUm3s5S4B3tN4KSFtWKafwHMv5rehKqzPkfFv7JmcYR46, address:79.127.219.45:4854): protocol: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection
Feb 6 14:39:24.043862961 (526h44m1.927817164s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 139.59.144.22:45966->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044055077 (526h44m1.928009282s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:48288->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044343069 (526h44m1.928297278s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1AFb6pwh2crCNjT7W7WU7dtd825DP1db64Gy2HkthZG3M46J8C, address:79.127.219.46:4890): protocol: read tcp 139.59.144.22:41962->79.127.219.46:4890: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044392088 (526h44m1.928346278s) [seg_pos={0 0}, upload=463520]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Feb 6 14:39:24.156254636 (526h44m2.040208853s) [upload=463520]: Done uploading segments...
Feb 6 14:39:24.156301646 (526h44m2.040255862s) [upload=463520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 2.376971855s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.43628075s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:44:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.436307819s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................X....X...................X.........X......] duration:
2.406965036s trace:
https://jaeger.dev.storj.io/trace/16f950045d00ca2c
FAIL (2026-02-06 14:43:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
eb 6 14:38:54.350721185 (526h43m32.234675389s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 14:38:54.350729375 (526h43m32.234683581s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 14:38:54.475554624 (526h43m32.359508823s) [seg_pos={0 0}, upload=463520]: Begin upload segment...
Feb 6 14:38:54.475621377 (526h43m32.359575576s) [seg_pos={0 0}, upload=463520]: Done begin upload segment.
Feb 6 14:38:54.475680834 (526h43m32.359635044s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.475716875 (526h43m32.359671084s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476416919 (526h43m32.360371129s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476994579 (526h43m32.360948786s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477136209 (526h43m32.361090412s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477688450 (526h43m32.361642659s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478260029 (526h43m32.362214238s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478385545 (526h43m32.362339738s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478800615 (526h43m32.362754822s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478816417 (526h43m32.36277062s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479234796 (526h43m32.363188985s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479399113 (526h43m32.363353352s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479638578 (526h43m32.36359278s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480003360 (526h43m32.363957572s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480564500 (526h43m32.364518707s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.482868054 (526h43m32.366822245s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:55.083498782 (526h43m32.967452989s) [upload=463520]: Next returned nil segment
Feb 6 14:38:55.083518072 (526h43m32.967472282s) [upload=463520]: Waiting for error group managing segments...
Feb 6 14:38:55.220887662 (526h43m33.104841863s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.221767546 (526h43m33.105721749s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.223626184 (526h43m33.107580389s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233117516 (526h43m33.117071715s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233574826 (526h43m33.117529028s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233869860 (526h43m33.117824063s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.236556731 (526h43m33.120510933s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237718058 (526h43m33.121672268s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237994236 (526h43m33.121948436s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:39:24.043453190 (526h44m1.927407397s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection
Feb 6 14:39:24.043494413 (526h44m1.927448641s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:39:24.043598366 (526h44m1.927552569s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection
Feb 6 14:39:24.043690919 (526h44m1.927645127s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12EpaUWUm3s5S4B3tN4KSFtWKafwHMv5rehKqzPkfFv7JmcYR46, address:79.127.219.45:4854): protocol: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection
Feb 6 14:39:24.043862961 (526h44m1.927817164s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 139.59.144.22:45966->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044055077 (526h44m1.928009282s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:48288->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044343069 (526h44m1.928297278s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1AFb6pwh2crCNjT7W7WU7dtd825DP1db64Gy2HkthZG3M46J8C, address:79.127.219.46:4890): protocol: read tcp 139.59.144.22:41962->79.127.219.46:4890: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044392088 (526h44m1.928346278s) [seg_pos={0 0}, upload=463520]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Feb 6 14:39:24.156254636 (526h44m2.040208853s) [upload=463520]: Done uploading segments...
Feb 6 14:39:24.156301646 (526h44m2.040255862s) [upload=463520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 2.407004846s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.405010635s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:43:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.405108919s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.463620454s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:43:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.463659008s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................X....X...................X.........X.....] duration:
2.369329093s trace:
https://jaeger.dev.storj.io/trace/16f950045d00ca2c
FAIL (2026-02-06 14:43:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
eb 6 14:38:54.350721185 (526h43m32.234675389s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 14:38:54.350729375 (526h43m32.234683581s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 14:38:54.475554624 (526h43m32.359508823s) [seg_pos={0 0}, upload=463520]: Begin upload segment...
Feb 6 14:38:54.475621377 (526h43m32.359575576s) [seg_pos={0 0}, upload=463520]: Done begin upload segment.
Feb 6 14:38:54.475680834 (526h43m32.359635044s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.475716875 (526h43m32.359671084s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476416919 (526h43m32.360371129s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476994579 (526h43m32.360948786s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477136209 (526h43m32.361090412s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477688450 (526h43m32.361642659s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478260029 (526h43m32.362214238s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478385545 (526h43m32.362339738s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478800615 (526h43m32.362754822s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478816417 (526h43m32.36277062s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479234796 (526h43m32.363188985s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479399113 (526h43m32.363353352s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479638578 (526h43m32.36359278s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480003360 (526h43m32.363957572s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480564500 (526h43m32.364518707s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.482868054 (526h43m32.366822245s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:55.083498782 (526h43m32.967452989s) [upload=463520]: Next returned nil segment
Feb 6 14:38:55.083518072 (526h43m32.967472282s) [upload=463520]: Waiting for error group managing segments...
Feb 6 14:38:55.220887662 (526h43m33.104841863s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.221767546 (526h43m33.105721749s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.223626184 (526h43m33.107580389s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233117516 (526h43m33.117071715s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233574826 (526h43m33.117529028s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233869860 (526h43m33.117824063s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.236556731 (526h43m33.120510933s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237718058 (526h43m33.121672268s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237994236 (526h43m33.121948436s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:39:24.043453190 (526h44m1.927407397s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection
Feb 6 14:39:24.043494413 (526h44m1.927448641s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:39:24.043598366 (526h44m1.927552569s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection
Feb 6 14:39:24.043690919 (526h44m1.927645127s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12EpaUWUm3s5S4B3tN4KSFtWKafwHMv5rehKqzPkfFv7JmcYR46, address:79.127.219.45:4854): protocol: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection
Feb 6 14:39:24.043862961 (526h44m1.927817164s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 139.59.144.22:45966->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044055077 (526h44m1.928009282s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:48288->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044343069 (526h44m1.928297278s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1AFb6pwh2crCNjT7W7WU7dtd825DP1db64Gy2HkthZG3M46J8C, address:79.127.219.46:4890): protocol: read tcp 139.59.144.22:41962->79.127.219.46:4890: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044392088 (526h44m1.928346278s) [seg_pos={0 0}, upload=463520]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Feb 6 14:39:24.156254636 (526h44m2.040208853s) [upload=463520]: Done uploading segments...
Feb 6 14:39:24.156301646 (526h44m2.040255862s) [upload=463520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 2.369459318s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.279800527s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:42:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.279827489s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................X....X...................X.........X....] duration:
2.426920165s trace:
https://jaeger.dev.storj.io/trace/16f950045d00ca2c
FAIL (2026-02-06 14:42:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
eb 6 14:38:54.350721185 (526h43m32.234675389s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 14:38:54.350729375 (526h43m32.234683581s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 14:38:54.475554624 (526h43m32.359508823s) [seg_pos={0 0}, upload=463520]: Begin upload segment...
Feb 6 14:38:54.475621377 (526h43m32.359575576s) [seg_pos={0 0}, upload=463520]: Done begin upload segment.
Feb 6 14:38:54.475680834 (526h43m32.359635044s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.475716875 (526h43m32.359671084s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476416919 (526h43m32.360371129s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476994579 (526h43m32.360948786s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477136209 (526h43m32.361090412s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477688450 (526h43m32.361642659s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478260029 (526h43m32.362214238s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478385545 (526h43m32.362339738s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478800615 (526h43m32.362754822s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478816417 (526h43m32.36277062s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479234796 (526h43m32.363188985s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479399113 (526h43m32.363353352s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479638578 (526h43m32.36359278s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480003360 (526h43m32.363957572s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480564500 (526h43m32.364518707s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.482868054 (526h43m32.366822245s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:55.083498782 (526h43m32.967452989s) [upload=463520]: Next returned nil segment
Feb 6 14:38:55.083518072 (526h43m32.967472282s) [upload=463520]: Waiting for error group managing segments...
Feb 6 14:38:55.220887662 (526h43m33.104841863s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.221767546 (526h43m33.105721749s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.223626184 (526h43m33.107580389s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233117516 (526h43m33.117071715s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233574826 (526h43m33.117529028s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233869860 (526h43m33.117824063s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.236556731 (526h43m33.120510933s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237718058 (526h43m33.121672268s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237994236 (526h43m33.121948436s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:39:24.043453190 (526h44m1.927407397s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection
Feb 6 14:39:24.043494413 (526h44m1.927448641s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:39:24.043598366 (526h44m1.927552569s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection
Feb 6 14:39:24.043690919 (526h44m1.927645127s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12EpaUWUm3s5S4B3tN4KSFtWKafwHMv5rehKqzPkfFv7JmcYR46, address:79.127.219.45:4854): protocol: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection
Feb 6 14:39:24.043862961 (526h44m1.927817164s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 139.59.144.22:45966->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044055077 (526h44m1.928009282s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:48288->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044343069 (526h44m1.928297278s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1AFb6pwh2crCNjT7W7WU7dtd825DP1db64Gy2HkthZG3M46J8C, address:79.127.219.46:4890): protocol: read tcp 139.59.144.22:41962->79.127.219.46:4890: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044392088 (526h44m1.928346278s) [seg_pos={0 0}, upload=463520]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Feb 6 14:39:24.156254636 (526h44m2.040208853s) [upload=463520]: Done uploading segments...
Feb 6 14:39:24.156301646 (526h44m2.040255862s) [upload=463520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 2.426970934s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................X....X...................X.........X...] duration:
2.431780048s trace:
https://jaeger.dev.storj.io/trace/16f950045d00ca2c
FAIL (2026-02-06 14:41:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
eb 6 14:38:54.350721185 (526h43m32.234675389s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 14:38:54.350729375 (526h43m32.234683581s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 14:38:54.475554624 (526h43m32.359508823s) [seg_pos={0 0}, upload=463520]: Begin upload segment...
Feb 6 14:38:54.475621377 (526h43m32.359575576s) [seg_pos={0 0}, upload=463520]: Done begin upload segment.
Feb 6 14:38:54.475680834 (526h43m32.359635044s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.475716875 (526h43m32.359671084s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476416919 (526h43m32.360371129s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476994579 (526h43m32.360948786s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477136209 (526h43m32.361090412s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477688450 (526h43m32.361642659s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478260029 (526h43m32.362214238s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478385545 (526h43m32.362339738s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478800615 (526h43m32.362754822s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478816417 (526h43m32.36277062s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479234796 (526h43m32.363188985s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479399113 (526h43m32.363353352s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479638578 (526h43m32.36359278s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480003360 (526h43m32.363957572s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480564500 (526h43m32.364518707s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.482868054 (526h43m32.366822245s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:55.083498782 (526h43m32.967452989s) [upload=463520]: Next returned nil segment
Feb 6 14:38:55.083518072 (526h43m32.967472282s) [upload=463520]: Waiting for error group managing segments...
Feb 6 14:38:55.220887662 (526h43m33.104841863s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.221767546 (526h43m33.105721749s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.223626184 (526h43m33.107580389s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233117516 (526h43m33.117071715s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233574826 (526h43m33.117529028s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233869860 (526h43m33.117824063s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.236556731 (526h43m33.120510933s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237718058 (526h43m33.121672268s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237994236 (526h43m33.121948436s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:39:24.043453190 (526h44m1.927407397s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection
Feb 6 14:39:24.043494413 (526h44m1.927448641s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:39:24.043598366 (526h44m1.927552569s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection
Feb 6 14:39:24.043690919 (526h44m1.927645127s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12EpaUWUm3s5S4B3tN4KSFtWKafwHMv5rehKqzPkfFv7JmcYR46, address:79.127.219.45:4854): protocol: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection
Feb 6 14:39:24.043862961 (526h44m1.927817164s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 139.59.144.22:45966->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044055077 (526h44m1.928009282s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:48288->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044343069 (526h44m1.928297278s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1AFb6pwh2crCNjT7W7WU7dtd825DP1db64Gy2HkthZG3M46J8C, address:79.127.219.46:4890): protocol: read tcp 139.59.144.22:41962->79.127.219.46:4890: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044392088 (526h44m1.928346278s) [seg_pos={0 0}, upload=463520]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Feb 6 14:39:24.156254636 (526h44m2.040208853s) [upload=463520]: Done uploading segments...
Feb 6 14:39:24.156301646 (526h44m2.040255862s) [upload=463520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 2.431818129s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.509366259s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:41:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.509409765s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.237099239s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:41:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.237150816s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [......................X....X...................X.........X..] duration:
2.360616798s trace:
https://jaeger.dev.storj.io/trace/16f950045d00ca2c
FAIL (2026-02-06 14:40:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
eb 6 14:38:54.350721185 (526h43m32.234675389s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 14:38:54.350729375 (526h43m32.234683581s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 14:38:54.475554624 (526h43m32.359508823s) [seg_pos={0 0}, upload=463520]: Begin upload segment...
Feb 6 14:38:54.475621377 (526h43m32.359575576s) [seg_pos={0 0}, upload=463520]: Done begin upload segment.
Feb 6 14:38:54.475680834 (526h43m32.359635044s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.475716875 (526h43m32.359671084s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476416919 (526h43m32.360371129s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476994579 (526h43m32.360948786s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477136209 (526h43m32.361090412s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477688450 (526h43m32.361642659s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478260029 (526h43m32.362214238s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478385545 (526h43m32.362339738s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478800615 (526h43m32.362754822s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478816417 (526h43m32.36277062s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479234796 (526h43m32.363188985s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479399113 (526h43m32.363353352s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479638578 (526h43m32.36359278s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480003360 (526h43m32.363957572s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480564500 (526h43m32.364518707s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.482868054 (526h43m32.366822245s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:55.083498782 (526h43m32.967452989s) [upload=463520]: Next returned nil segment
Feb 6 14:38:55.083518072 (526h43m32.967472282s) [upload=463520]: Waiting for error group managing segments...
Feb 6 14:38:55.220887662 (526h43m33.104841863s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.221767546 (526h43m33.105721749s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.223626184 (526h43m33.107580389s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233117516 (526h43m33.117071715s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233574826 (526h43m33.117529028s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233869860 (526h43m33.117824063s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.236556731 (526h43m33.120510933s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237718058 (526h43m33.121672268s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237994236 (526h43m33.121948436s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:39:24.043453190 (526h44m1.927407397s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection
Feb 6 14:39:24.043494413 (526h44m1.927448641s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:39:24.043598366 (526h44m1.927552569s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection
Feb 6 14:39:24.043690919 (526h44m1.927645127s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12EpaUWUm3s5S4B3tN4KSFtWKafwHMv5rehKqzPkfFv7JmcYR46, address:79.127.219.45:4854): protocol: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection
Feb 6 14:39:24.043862961 (526h44m1.927817164s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 139.59.144.22:45966->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044055077 (526h44m1.928009282s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:48288->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044343069 (526h44m1.928297278s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1AFb6pwh2crCNjT7W7WU7dtd825DP1db64Gy2HkthZG3M46J8C, address:79.127.219.46:4890): protocol: read tcp 139.59.144.22:41962->79.127.219.46:4890: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044392088 (526h44m1.928346278s) [seg_pos={0 0}, upload=463520]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Feb 6 14:39:24.156254636 (526h44m2.040208853s) [upload=463520]: Done uploading segments...
Feb 6 14:39:24.156301646 (526h44m2.040255862s) [upload=463520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 2.360642624s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.881072472s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:40:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.881098019s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......................X....X...................X.........X.] duration:
2.317975839s trace:
https://jaeger.dev.storj.io/trace/16f950045d00ca2c
FAIL (2026-02-06 14:39:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
eb 6 14:38:54.350721185 (526h43m32.234675389s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 14:38:54.350729375 (526h43m32.234683581s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 14:38:54.475554624 (526h43m32.359508823s) [seg_pos={0 0}, upload=463520]: Begin upload segment...
Feb 6 14:38:54.475621377 (526h43m32.359575576s) [seg_pos={0 0}, upload=463520]: Done begin upload segment.
Feb 6 14:38:54.475680834 (526h43m32.359635044s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.475716875 (526h43m32.359671084s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476416919 (526h43m32.360371129s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476994579 (526h43m32.360948786s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477136209 (526h43m32.361090412s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477688450 (526h43m32.361642659s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478260029 (526h43m32.362214238s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478385545 (526h43m32.362339738s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478800615 (526h43m32.362754822s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478816417 (526h43m32.36277062s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479234796 (526h43m32.363188985s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479399113 (526h43m32.363353352s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479638578 (526h43m32.36359278s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480003360 (526h43m32.363957572s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480564500 (526h43m32.364518707s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.482868054 (526h43m32.366822245s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:55.083498782 (526h43m32.967452989s) [upload=463520]: Next returned nil segment
Feb 6 14:38:55.083518072 (526h43m32.967472282s) [upload=463520]: Waiting for error group managing segments...
Feb 6 14:38:55.220887662 (526h43m33.104841863s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.221767546 (526h43m33.105721749s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.223626184 (526h43m33.107580389s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233117516 (526h43m33.117071715s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233574826 (526h43m33.117529028s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233869860 (526h43m33.117824063s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.236556731 (526h43m33.120510933s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237718058 (526h43m33.121672268s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237994236 (526h43m33.121948436s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:39:24.043453190 (526h44m1.927407397s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection
Feb 6 14:39:24.043494413 (526h44m1.927448641s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:39:24.043598366 (526h44m1.927552569s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection
Feb 6 14:39:24.043690919 (526h44m1.927645127s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12EpaUWUm3s5S4B3tN4KSFtWKafwHMv5rehKqzPkfFv7JmcYR46, address:79.127.219.45:4854): protocol: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection
Feb 6 14:39:24.043862961 (526h44m1.927817164s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 139.59.144.22:45966->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044055077 (526h44m1.928009282s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:48288->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044343069 (526h44m1.928297278s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1AFb6pwh2crCNjT7W7WU7dtd825DP1db64Gy2HkthZG3M46J8C, address:79.127.219.46:4890): protocol: read tcp 139.59.144.22:41962->79.127.219.46:4890: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044392088 (526h44m1.928346278s) [seg_pos={0 0}, upload=463520]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Feb 6 14:39:24.156254636 (526h44m2.040208853s) [upload=463520]: Done uploading segments...
Feb 6 14:39:24.156301646 (526h44m2.040255862s) [upload=463520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 2.31799849s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
40.026482507s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:39:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 40.02650914s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [........................X....X...................X.........X] duration:
30.115059706s trace:
https://jaeger.dev.storj.io/trace/16f950045d00ca2c
FAIL (2026-02-06 14:39:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
eb 6 14:38:54.350721185 (526h43m32.234675389s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 14:38:54.350729375 (526h43m32.234683581s) [upload=463520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 14:38:54.475554624 (526h43m32.359508823s) [seg_pos={0 0}, upload=463520]: Begin upload segment...
Feb 6 14:38:54.475621377 (526h43m32.359575576s) [seg_pos={0 0}, upload=463520]: Done begin upload segment.
Feb 6 14:38:54.475680834 (526h43m32.359635044s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.475716875 (526h43m32.359671084s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476416919 (526h43m32.360371129s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.476994579 (526h43m32.360948786s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477136209 (526h43m32.361090412s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.477688450 (526h43m32.361642659s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478260029 (526h43m32.362214238s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478385545 (526h43m32.362339738s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478800615 (526h43m32.362754822s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.478816417 (526h43m32.36277062s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479234796 (526h43m32.363188985s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479399113 (526h43m32.363353352s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.479638578 (526h43m32.36359278s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480003360 (526h43m32.363957572s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.480564500 (526h43m32.364518707s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:54.482868054 (526h43m32.366822245s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Uploading piece...
Feb 6 14:38:55.083498782 (526h43m32.967452989s) [upload=463520]: Next returned nil segment
Feb 6 14:38:55.083518072 (526h43m32.967472282s) [upload=463520]: Waiting for error group managing segments...
Feb 6 14:38:55.220887662 (526h43m33.104841863s) [noise=true , address=45.91.116.9:4264 , piece_id=BIOI6U2ZS3IOM6N4RNYEY53ROI26N7CS57634PGFF46JTXM2E5ZQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.221767546 (526h43m33.105721749s) [noise=true , address=45.91.116.11:4120 , piece_id=ECI46HVMSU7EPKEHOOACQ4WOXOEGJBHJCBAAARHDUFFOCSZX4ZVA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.223626184 (526h43m33.107580389s) [noise=true , address=45.91.116.4:4955 , piece_id=U7LD4HI5FR3FWLCNGYFR7FDCOYI7JZSPO5QDOS3R7X2ZYDNLILTQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233117516 (526h43m33.117071715s) [noise=true , address=45.91.116.14:4224 , piece_id=UX7CTK2YHL7WHXYJCLLKDO2U2GPDRQJAWG4RXZIKNZTVONVTXWPA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233574826 (526h43m33.117529028s) [noise=true , address=45.91.116.7:4012 , piece_id=IKRKQFJ7V3ZHRKJ6XTLPRRDMOL2KJUYDSH75D7GF4PAZFAH4YLUQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.233869860 (526h43m33.117824063s) [noise=true , address=45.91.116.12:4228 , piece_id=DVQ3KKU5HKSXMMQFR4NWFVU2WHOUB3R2W5KOCBK2Y7IGV2FGFNKQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.236556731 (526h43m33.120510933s) [noise=true , address=45.91.116.10:4081 , piece_id=APWKS4NLDTQ7ER3YOTDVYMABTB2ZVYXEAXXXJZY6PKNECBI7BDHA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237718058 (526h43m33.121672268s) [noise=true , address=45.91.116.6:4980 , piece_id=NMRBRP3HSMAW3TJQB3FWYICSMVR3MPHZW6EHDIHNSWFAHCPIXB4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:38:55.237994236 (526h43m33.121948436s) [noise=true , address=45.91.116.13:4153 , piece_id=Q4W6YQ4OPZZSI45WWRQ4E4TFEZON3C7UKQT3BDNYVH47SDUY7Y2Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: <nil>
Feb 6 14:39:24.043453190 (526h44m1.927407397s) [noise=true , address=77.90.31.16:4736 , piece_id=QTOR36KFEKCSVWNHVWDWDSPHXN3DMAVNT4QKUWZF32UDPEG734PA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38832->77.90.31.16:4736: use of closed network connection
Feb 6 14:39:24.043494413 (526h44m1.927448641s) [noise=true , address=77.90.31.12:4590 , piece_id=TJW2N77H4IY6KJIBFNBIXDTBEQ7Q4T2AVNERMLTHIHKJJ3XAGPMA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:39:24.043598366 (526h44m1.927552569s) [noise=true , address=77.90.31.10:4520 , piece_id=6OBELOER7ADNF7ON5NF46PXO74Q75MOIYL7ZFUM4CNYSLGOTO2KA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41242->77.90.31.10:4520: use of closed network connection
Feb 6 14:39:24.043690919 (526h44m1.927645127s) [noise=true , address=79.127.219.45:4854 , piece_id=KF7SLU6VA5R7CRWNKHWWAKVV6ABQJ54OGHFIKS4FQ4PRNIIEMCOA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12EpaUWUm3s5S4B3tN4KSFtWKafwHMv5rehKqzPkfFv7JmcYR46, address:79.127.219.45:4854): protocol: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40444->79.127.219.45:4854: use of closed network connection
Feb 6 14:39:24.043862961 (526h44m1.927817164s) [noise=true , address=77.90.31.21:4877 , piece_id=XX4ZCCFYG3WHEYN7PX4MPU5RESPCE3GGE57KY5DHBVMPB6PHEW4Q, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 139.59.144.22:45966->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044055077 (526h44m1.928009282s) [noise=true , address=77.90.31.11:4556 , piece_id=J3FDRQU5RPZIANFUXJL6EMEMQRU3YQAKO2SUYBCU53PCWBWOBELQ, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:48288->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044343069 (526h44m1.928297278s) [noise=true , address=79.127.219.46:4890 , piece_id=4GV6SWHPDHP2MONSS4BWUABBLY6FYW6MKNCHHCTU444JD35AUHYA, seg_pos={0 0}, upload=463520]: Done uploading piece. err: ecclient: upload failed (node:1AFb6pwh2crCNjT7W7WU7dtd825DP1db64Gy2HkthZG3M46J8C, address:79.127.219.46:4890): protocol: read tcp 139.59.144.22:41962->79.127.219.46:4890: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:39:24.044392088 (526h44m1.928346278s) [seg_pos={0 0}, upload=463520]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Feb 6 14:39:24.156254636 (526h44m2.040208853s) [upload=463520]: Done uploading segments...
Feb 6 14:39:24.156301646 (526h44m2.040255862s) [upload=463520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 30.115086231s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.403063458s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:38:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.403090086s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X....X...................X.........] duration:
2.321064513s trace:
https://jaeger.dev.storj.io/trace/4d0f07a5cc381cc7
FAIL (2026-02-06 14:37:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
Begin
Feb 6 14:31:50.916444991 (526h36m28.800399202s) [seg_pos={0 0}, upload=463421]: Begin upload segment...
Feb 6 14:31:50.916522115 (526h36m28.800476416s) [seg_pos={0 0}, upload=463421]: Done begin upload segment.
Feb 6 14:31:50.916584075 (526h36m28.800538285s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.923692816 (526h36m28.807647029s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.925592922 (526h36m28.809547132s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.927680569 (526h36m28.811634789s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.929536460 (526h36m28.813490672s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931323015 (526h36m28.815277235s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931799738 (526h36m28.815753949s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.933462710 (526h36m28.817416923s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.935199643 (526h36m28.819153869s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.937161412 (526h36m28.821115653s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.939081647 (526h36m28.823035858s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.940949627 (526h36m28.824903839s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.941645191 (526h36m28.825599411s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.943631825 (526h36m28.827586038s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.945738304 (526h36m28.829692515s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.947054123 (526h36m28.831008392s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:51.551404309 (526h36m29.435358494s) [upload=463421]: Next returned nil segment
Feb 6 14:31:51.551425282 (526h36m29.435379482s) [upload=463421]: Waiting for error group managing segments...
Feb 6 14:31:51.692165074 (526h36m29.57611928s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.693692206 (526h36m29.577646411s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.694121668 (526h36m29.578075867s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.704320788 (526h36m29.588274981s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.709982886 (526h36m29.593937085s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.716091355 (526h36m29.600045659s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.724843857 (526h36m29.608798066s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:53.326122186 (526h36m31.210076386s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:32:20.485662904 (526h36m58.369617117s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection
Feb 6 14:32:20.485796730 (526h36m58.369750932s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: read tcp 139.59.144.22:54076->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.485945901 (526h36m58.369900107s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12ZvUdXiXPFGqmVzYffAp735GjzaSMcyUfTD61Yi6us9ETg7Ath, address:79.127.219.38:4818): protocol: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection
Feb 6 14:32:20.485996958 (526h36m58.369951158s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:35974->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486171103 (526h36m58.37012531s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:56900->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486306758 (526h36m58.370260961s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34942->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486488608 (526h36m58.370442813s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:49178->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486629707 (526h36m58.370583953s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:54300->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486651465 (526h36m58.37060565s) [seg_pos={0 0}, upload=463421]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 6 14:32:20.597706601 (526h36m58.4816608s) [upload=463421]: Done uploading segments...
Feb 6 14:32:20.597756789 (526h36m58.481710989s) [upload=463421]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.321136746s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X....X...................X........] duration:
2.367059886s trace:
https://jaeger.dev.storj.io/trace/4d0f07a5cc381cc7
FAIL (2026-02-06 14:37:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
Begin
Feb 6 14:31:50.916444991 (526h36m28.800399202s) [seg_pos={0 0}, upload=463421]: Begin upload segment...
Feb 6 14:31:50.916522115 (526h36m28.800476416s) [seg_pos={0 0}, upload=463421]: Done begin upload segment.
Feb 6 14:31:50.916584075 (526h36m28.800538285s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.923692816 (526h36m28.807647029s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.925592922 (526h36m28.809547132s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.927680569 (526h36m28.811634789s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.929536460 (526h36m28.813490672s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931323015 (526h36m28.815277235s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931799738 (526h36m28.815753949s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.933462710 (526h36m28.817416923s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.935199643 (526h36m28.819153869s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.937161412 (526h36m28.821115653s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.939081647 (526h36m28.823035858s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.940949627 (526h36m28.824903839s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.941645191 (526h36m28.825599411s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.943631825 (526h36m28.827586038s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.945738304 (526h36m28.829692515s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.947054123 (526h36m28.831008392s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:51.551404309 (526h36m29.435358494s) [upload=463421]: Next returned nil segment
Feb 6 14:31:51.551425282 (526h36m29.435379482s) [upload=463421]: Waiting for error group managing segments...
Feb 6 14:31:51.692165074 (526h36m29.57611928s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.693692206 (526h36m29.577646411s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.694121668 (526h36m29.578075867s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.704320788 (526h36m29.588274981s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.709982886 (526h36m29.593937085s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.716091355 (526h36m29.600045659s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.724843857 (526h36m29.608798066s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:53.326122186 (526h36m31.210076386s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:32:20.485662904 (526h36m58.369617117s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection
Feb 6 14:32:20.485796730 (526h36m58.369750932s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: read tcp 139.59.144.22:54076->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.485945901 (526h36m58.369900107s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12ZvUdXiXPFGqmVzYffAp735GjzaSMcyUfTD61Yi6us9ETg7Ath, address:79.127.219.38:4818): protocol: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection
Feb 6 14:32:20.485996958 (526h36m58.369951158s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:35974->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486171103 (526h36m58.37012531s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:56900->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486306758 (526h36m58.370260961s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34942->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486488608 (526h36m58.370442813s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:49178->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486629707 (526h36m58.370583953s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:54300->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486651465 (526h36m58.37060565s) [seg_pos={0 0}, upload=463421]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 6 14:32:20.597706601 (526h36m58.4816608s) [upload=463421]: Done uploading segments...
Feb 6 14:32:20.597756789 (526h36m58.481710989s) [upload=463421]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.367087919s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.409103204s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:37:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.409136308s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.4497951s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:36:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.449892206s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X....X...................X.......] duration:
2.366640688s trace:
https://jaeger.dev.storj.io/trace/4d0f07a5cc381cc7
FAIL (2026-02-06 14:36:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
Begin
Feb 6 14:31:50.916444991 (526h36m28.800399202s) [seg_pos={0 0}, upload=463421]: Begin upload segment...
Feb 6 14:31:50.916522115 (526h36m28.800476416s) [seg_pos={0 0}, upload=463421]: Done begin upload segment.
Feb 6 14:31:50.916584075 (526h36m28.800538285s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.923692816 (526h36m28.807647029s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.925592922 (526h36m28.809547132s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.927680569 (526h36m28.811634789s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.929536460 (526h36m28.813490672s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931323015 (526h36m28.815277235s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931799738 (526h36m28.815753949s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.933462710 (526h36m28.817416923s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.935199643 (526h36m28.819153869s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.937161412 (526h36m28.821115653s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.939081647 (526h36m28.823035858s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.940949627 (526h36m28.824903839s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.941645191 (526h36m28.825599411s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.943631825 (526h36m28.827586038s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.945738304 (526h36m28.829692515s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.947054123 (526h36m28.831008392s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:51.551404309 (526h36m29.435358494s) [upload=463421]: Next returned nil segment
Feb 6 14:31:51.551425282 (526h36m29.435379482s) [upload=463421]: Waiting for error group managing segments...
Feb 6 14:31:51.692165074 (526h36m29.57611928s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.693692206 (526h36m29.577646411s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.694121668 (526h36m29.578075867s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.704320788 (526h36m29.588274981s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.709982886 (526h36m29.593937085s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.716091355 (526h36m29.600045659s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.724843857 (526h36m29.608798066s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:53.326122186 (526h36m31.210076386s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:32:20.485662904 (526h36m58.369617117s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection
Feb 6 14:32:20.485796730 (526h36m58.369750932s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: read tcp 139.59.144.22:54076->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.485945901 (526h36m58.369900107s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12ZvUdXiXPFGqmVzYffAp735GjzaSMcyUfTD61Yi6us9ETg7Ath, address:79.127.219.38:4818): protocol: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection
Feb 6 14:32:20.485996958 (526h36m58.369951158s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:35974->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486171103 (526h36m58.37012531s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:56900->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486306758 (526h36m58.370260961s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34942->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486488608 (526h36m58.370442813s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:49178->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486629707 (526h36m58.370583953s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:54300->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486651465 (526h36m58.37060565s) [seg_pos={0 0}, upload=463421]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 6 14:32:20.597706601 (526h36m58.4816608s) [upload=463421]: Done uploading segments...
Feb 6 14:32:20.597756789 (526h36m58.481710989s) [upload=463421]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.366669707s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.250759214s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:35:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.250807467s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X....X...................X......] duration:
2.40085282s trace:
https://jaeger.dev.storj.io/trace/4d0f07a5cc381cc7
FAIL (2026-02-06 14:35:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
Begin
Feb 6 14:31:50.916444991 (526h36m28.800399202s) [seg_pos={0 0}, upload=463421]: Begin upload segment...
Feb 6 14:31:50.916522115 (526h36m28.800476416s) [seg_pos={0 0}, upload=463421]: Done begin upload segment.
Feb 6 14:31:50.916584075 (526h36m28.800538285s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.923692816 (526h36m28.807647029s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.925592922 (526h36m28.809547132s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.927680569 (526h36m28.811634789s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.929536460 (526h36m28.813490672s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931323015 (526h36m28.815277235s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931799738 (526h36m28.815753949s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.933462710 (526h36m28.817416923s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.935199643 (526h36m28.819153869s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.937161412 (526h36m28.821115653s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.939081647 (526h36m28.823035858s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.940949627 (526h36m28.824903839s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.941645191 (526h36m28.825599411s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.943631825 (526h36m28.827586038s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.945738304 (526h36m28.829692515s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.947054123 (526h36m28.831008392s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:51.551404309 (526h36m29.435358494s) [upload=463421]: Next returned nil segment
Feb 6 14:31:51.551425282 (526h36m29.435379482s) [upload=463421]: Waiting for error group managing segments...
Feb 6 14:31:51.692165074 (526h36m29.57611928s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.693692206 (526h36m29.577646411s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.694121668 (526h36m29.578075867s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.704320788 (526h36m29.588274981s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.709982886 (526h36m29.593937085s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.716091355 (526h36m29.600045659s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.724843857 (526h36m29.608798066s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:53.326122186 (526h36m31.210076386s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:32:20.485662904 (526h36m58.369617117s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection
Feb 6 14:32:20.485796730 (526h36m58.369750932s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: read tcp 139.59.144.22:54076->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.485945901 (526h36m58.369900107s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12ZvUdXiXPFGqmVzYffAp735GjzaSMcyUfTD61Yi6us9ETg7Ath, address:79.127.219.38:4818): protocol: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection
Feb 6 14:32:20.485996958 (526h36m58.369951158s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:35974->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486171103 (526h36m58.37012531s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:56900->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486306758 (526h36m58.370260961s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34942->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486488608 (526h36m58.370442813s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:49178->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486629707 (526h36m58.370583953s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:54300->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486651465 (526h36m58.37060565s) [seg_pos={0 0}, upload=463421]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 6 14:32:20.597706601 (526h36m58.4816608s) [upload=463421]: Done uploading segments...
Feb 6 14:32:20.597756789 (526h36m58.481710989s) [upload=463421]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.400895364s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.446694159s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:35:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.446765303s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............................X....X...................X.....] duration:
2.33828973s trace:
https://jaeger.dev.storj.io/trace/4d0f07a5cc381cc7
FAIL (2026-02-06 14:34:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
Begin
Feb 6 14:31:50.916444991 (526h36m28.800399202s) [seg_pos={0 0}, upload=463421]: Begin upload segment...
Feb 6 14:31:50.916522115 (526h36m28.800476416s) [seg_pos={0 0}, upload=463421]: Done begin upload segment.
Feb 6 14:31:50.916584075 (526h36m28.800538285s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.923692816 (526h36m28.807647029s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.925592922 (526h36m28.809547132s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.927680569 (526h36m28.811634789s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.929536460 (526h36m28.813490672s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931323015 (526h36m28.815277235s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931799738 (526h36m28.815753949s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.933462710 (526h36m28.817416923s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.935199643 (526h36m28.819153869s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.937161412 (526h36m28.821115653s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.939081647 (526h36m28.823035858s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.940949627 (526h36m28.824903839s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.941645191 (526h36m28.825599411s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.943631825 (526h36m28.827586038s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.945738304 (526h36m28.829692515s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.947054123 (526h36m28.831008392s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:51.551404309 (526h36m29.435358494s) [upload=463421]: Next returned nil segment
Feb 6 14:31:51.551425282 (526h36m29.435379482s) [upload=463421]: Waiting for error group managing segments...
Feb 6 14:31:51.692165074 (526h36m29.57611928s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.693692206 (526h36m29.577646411s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.694121668 (526h36m29.578075867s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.704320788 (526h36m29.588274981s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.709982886 (526h36m29.593937085s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.716091355 (526h36m29.600045659s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.724843857 (526h36m29.608798066s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:53.326122186 (526h36m31.210076386s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:32:20.485662904 (526h36m58.369617117s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection
Feb 6 14:32:20.485796730 (526h36m58.369750932s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: read tcp 139.59.144.22:54076->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.485945901 (526h36m58.369900107s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12ZvUdXiXPFGqmVzYffAp735GjzaSMcyUfTD61Yi6us9ETg7Ath, address:79.127.219.38:4818): protocol: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection
Feb 6 14:32:20.485996958 (526h36m58.369951158s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:35974->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486171103 (526h36m58.37012531s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:56900->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486306758 (526h36m58.370260961s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34942->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486488608 (526h36m58.370442813s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:49178->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486629707 (526h36m58.370583953s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:54300->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486651465 (526h36m58.37060565s) [seg_pos={0 0}, upload=463421]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 6 14:32:20.597706601 (526h36m58.4816608s) [upload=463421]: Done uploading segments...
Feb 6 14:32:20.597756789 (526h36m58.481710989s) [upload=463421]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.338319286s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............................X....X...................X....] duration:
2.275363135s trace:
https://jaeger.dev.storj.io/trace/4d0f07a5cc381cc7
FAIL (2026-02-06 14:34:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
Begin
Feb 6 14:31:50.916444991 (526h36m28.800399202s) [seg_pos={0 0}, upload=463421]: Begin upload segment...
Feb 6 14:31:50.916522115 (526h36m28.800476416s) [seg_pos={0 0}, upload=463421]: Done begin upload segment.
Feb 6 14:31:50.916584075 (526h36m28.800538285s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.923692816 (526h36m28.807647029s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.925592922 (526h36m28.809547132s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.927680569 (526h36m28.811634789s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.929536460 (526h36m28.813490672s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931323015 (526h36m28.815277235s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931799738 (526h36m28.815753949s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.933462710 (526h36m28.817416923s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.935199643 (526h36m28.819153869s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.937161412 (526h36m28.821115653s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.939081647 (526h36m28.823035858s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.940949627 (526h36m28.824903839s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.941645191 (526h36m28.825599411s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.943631825 (526h36m28.827586038s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.945738304 (526h36m28.829692515s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.947054123 (526h36m28.831008392s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:51.551404309 (526h36m29.435358494s) [upload=463421]: Next returned nil segment
Feb 6 14:31:51.551425282 (526h36m29.435379482s) [upload=463421]: Waiting for error group managing segments...
Feb 6 14:31:51.692165074 (526h36m29.57611928s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.693692206 (526h36m29.577646411s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.694121668 (526h36m29.578075867s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.704320788 (526h36m29.588274981s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.709982886 (526h36m29.593937085s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.716091355 (526h36m29.600045659s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.724843857 (526h36m29.608798066s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:53.326122186 (526h36m31.210076386s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:32:20.485662904 (526h36m58.369617117s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection
Feb 6 14:32:20.485796730 (526h36m58.369750932s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: read tcp 139.59.144.22:54076->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.485945901 (526h36m58.369900107s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12ZvUdXiXPFGqmVzYffAp735GjzaSMcyUfTD61Yi6us9ETg7Ath, address:79.127.219.38:4818): protocol: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection
Feb 6 14:32:20.485996958 (526h36m58.369951158s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:35974->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486171103 (526h36m58.37012531s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:56900->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486306758 (526h36m58.370260961s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34942->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486488608 (526h36m58.370442813s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:49178->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486629707 (526h36m58.370583953s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:54300->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486651465 (526h36m58.37060565s) [seg_pos={0 0}, upload=463421]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 6 14:32:20.597706601 (526h36m58.4816608s) [upload=463421]: Done uploading segments...
Feb 6 14:32:20.597756789 (526h36m58.481710989s) [upload=463421]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.275395974s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.340175334s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:34:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.340305949s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............................X....X...................X...] duration:
2.404881864s trace:
https://jaeger.dev.storj.io/trace/4d0f07a5cc381cc7
FAIL (2026-02-06 14:33:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
Begin
Feb 6 14:31:50.916444991 (526h36m28.800399202s) [seg_pos={0 0}, upload=463421]: Begin upload segment...
Feb 6 14:31:50.916522115 (526h36m28.800476416s) [seg_pos={0 0}, upload=463421]: Done begin upload segment.
Feb 6 14:31:50.916584075 (526h36m28.800538285s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.923692816 (526h36m28.807647029s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.925592922 (526h36m28.809547132s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.927680569 (526h36m28.811634789s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.929536460 (526h36m28.813490672s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931323015 (526h36m28.815277235s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931799738 (526h36m28.815753949s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.933462710 (526h36m28.817416923s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.935199643 (526h36m28.819153869s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.937161412 (526h36m28.821115653s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.939081647 (526h36m28.823035858s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.940949627 (526h36m28.824903839s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.941645191 (526h36m28.825599411s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.943631825 (526h36m28.827586038s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.945738304 (526h36m28.829692515s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.947054123 (526h36m28.831008392s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:51.551404309 (526h36m29.435358494s) [upload=463421]: Next returned nil segment
Feb 6 14:31:51.551425282 (526h36m29.435379482s) [upload=463421]: Waiting for error group managing segments...
Feb 6 14:31:51.692165074 (526h36m29.57611928s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.693692206 (526h36m29.577646411s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.694121668 (526h36m29.578075867s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.704320788 (526h36m29.588274981s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.709982886 (526h36m29.593937085s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.716091355 (526h36m29.600045659s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.724843857 (526h36m29.608798066s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:53.326122186 (526h36m31.210076386s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:32:20.485662904 (526h36m58.369617117s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection
Feb 6 14:32:20.485796730 (526h36m58.369750932s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: read tcp 139.59.144.22:54076->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.485945901 (526h36m58.369900107s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12ZvUdXiXPFGqmVzYffAp735GjzaSMcyUfTD61Yi6us9ETg7Ath, address:79.127.219.38:4818): protocol: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection
Feb 6 14:32:20.485996958 (526h36m58.369951158s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:35974->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486171103 (526h36m58.37012531s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:56900->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486306758 (526h36m58.370260961s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34942->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486488608 (526h36m58.370442813s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:49178->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486629707 (526h36m58.370583953s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:54300->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486651465 (526h36m58.37060565s) [seg_pos={0 0}, upload=463421]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 6 14:32:20.597706601 (526h36m58.4816608s) [upload=463421]: Done uploading segments...
Feb 6 14:32:20.597756789 (526h36m58.481710989s) [upload=463421]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.404918107s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [................................X....X...................X..] duration:
2.524609714s trace:
https://jaeger.dev.storj.io/trace/4d0f07a5cc381cc7
FAIL (2026-02-06 14:33:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
Begin
Feb 6 14:31:50.916444991 (526h36m28.800399202s) [seg_pos={0 0}, upload=463421]: Begin upload segment...
Feb 6 14:31:50.916522115 (526h36m28.800476416s) [seg_pos={0 0}, upload=463421]: Done begin upload segment.
Feb 6 14:31:50.916584075 (526h36m28.800538285s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.923692816 (526h36m28.807647029s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.925592922 (526h36m28.809547132s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.927680569 (526h36m28.811634789s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.929536460 (526h36m28.813490672s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931323015 (526h36m28.815277235s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931799738 (526h36m28.815753949s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.933462710 (526h36m28.817416923s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.935199643 (526h36m28.819153869s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.937161412 (526h36m28.821115653s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.939081647 (526h36m28.823035858s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.940949627 (526h36m28.824903839s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.941645191 (526h36m28.825599411s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.943631825 (526h36m28.827586038s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.945738304 (526h36m28.829692515s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.947054123 (526h36m28.831008392s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:51.551404309 (526h36m29.435358494s) [upload=463421]: Next returned nil segment
Feb 6 14:31:51.551425282 (526h36m29.435379482s) [upload=463421]: Waiting for error group managing segments...
Feb 6 14:31:51.692165074 (526h36m29.57611928s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.693692206 (526h36m29.577646411s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.694121668 (526h36m29.578075867s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.704320788 (526h36m29.588274981s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.709982886 (526h36m29.593937085s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.716091355 (526h36m29.600045659s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.724843857 (526h36m29.608798066s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:53.326122186 (526h36m31.210076386s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:32:20.485662904 (526h36m58.369617117s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection
Feb 6 14:32:20.485796730 (526h36m58.369750932s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: read tcp 139.59.144.22:54076->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.485945901 (526h36m58.369900107s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12ZvUdXiXPFGqmVzYffAp735GjzaSMcyUfTD61Yi6us9ETg7Ath, address:79.127.219.38:4818): protocol: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection
Feb 6 14:32:20.485996958 (526h36m58.369951158s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:35974->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486171103 (526h36m58.37012531s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:56900->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486306758 (526h36m58.370260961s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34942->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486488608 (526h36m58.370442813s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:49178->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486629707 (526h36m58.370583953s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:54300->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486651465 (526h36m58.37060565s) [seg_pos={0 0}, upload=463421]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 6 14:32:20.597706601 (526h36m58.4816608s) [upload=463421]: Done uploading segments...
Feb 6 14:32:20.597756789 (526h36m58.481710989s) [upload=463421]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.524657071s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................X....X...................X.] duration:
26.465753705s trace:
https://jaeger.dev.storj.io/trace/4d0f07a5cc381cc7
FAIL (2026-02-06 14:32:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
Begin
Feb 6 14:31:50.916444991 (526h36m28.800399202s) [seg_pos={0 0}, upload=463421]: Begin upload segment...
Feb 6 14:31:50.916522115 (526h36m28.800476416s) [seg_pos={0 0}, upload=463421]: Done begin upload segment.
Feb 6 14:31:50.916584075 (526h36m28.800538285s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.923692816 (526h36m28.807647029s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.925592922 (526h36m28.809547132s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.927680569 (526h36m28.811634789s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.929536460 (526h36m28.813490672s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931323015 (526h36m28.815277235s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931799738 (526h36m28.815753949s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.933462710 (526h36m28.817416923s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.935199643 (526h36m28.819153869s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.937161412 (526h36m28.821115653s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.939081647 (526h36m28.823035858s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.940949627 (526h36m28.824903839s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.941645191 (526h36m28.825599411s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.943631825 (526h36m28.827586038s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.945738304 (526h36m28.829692515s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.947054123 (526h36m28.831008392s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:51.551404309 (526h36m29.435358494s) [upload=463421]: Next returned nil segment
Feb 6 14:31:51.551425282 (526h36m29.435379482s) [upload=463421]: Waiting for error group managing segments...
Feb 6 14:31:51.692165074 (526h36m29.57611928s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.693692206 (526h36m29.577646411s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.694121668 (526h36m29.578075867s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.704320788 (526h36m29.588274981s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.709982886 (526h36m29.593937085s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.716091355 (526h36m29.600045659s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.724843857 (526h36m29.608798066s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:53.326122186 (526h36m31.210076386s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:32:20.485662904 (526h36m58.369617117s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection
Feb 6 14:32:20.485796730 (526h36m58.369750932s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: read tcp 139.59.144.22:54076->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.485945901 (526h36m58.369900107s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12ZvUdXiXPFGqmVzYffAp735GjzaSMcyUfTD61Yi6us9ETg7Ath, address:79.127.219.38:4818): protocol: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection
Feb 6 14:32:20.485996958 (526h36m58.369951158s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:35974->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486171103 (526h36m58.37012531s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:56900->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486306758 (526h36m58.370260961s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34942->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486488608 (526h36m58.370442813s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:49178->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486629707 (526h36m58.370583953s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:54300->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486651465 (526h36m58.37060565s) [seg_pos={0 0}, upload=463421]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 6 14:32:20.597706601 (526h36m58.4816608s) [upload=463421]: Done uploading segments...
Feb 6 14:32:20.597756789 (526h36m58.481710989s) [upload=463421]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 26.465808451s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.54115711s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:32:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.541176591s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
40.849929094s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:32:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 40.849957099s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................................X....X...................X] duration:
30.113604486s trace:
https://jaeger.dev.storj.io/trace/4d0f07a5cc381cc7
FAIL (2026-02-06 14:32:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
Begin
Feb 6 14:31:50.916444991 (526h36m28.800399202s) [seg_pos={0 0}, upload=463421]: Begin upload segment...
Feb 6 14:31:50.916522115 (526h36m28.800476416s) [seg_pos={0 0}, upload=463421]: Done begin upload segment.
Feb 6 14:31:50.916584075 (526h36m28.800538285s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.923692816 (526h36m28.807647029s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.925592922 (526h36m28.809547132s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.927680569 (526h36m28.811634789s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.929536460 (526h36m28.813490672s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931323015 (526h36m28.815277235s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.931799738 (526h36m28.815753949s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.933462710 (526h36m28.817416923s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.935199643 (526h36m28.819153869s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.937161412 (526h36m28.821115653s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.939081647 (526h36m28.823035858s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.940949627 (526h36m28.824903839s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.941645191 (526h36m28.825599411s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.943631825 (526h36m28.827586038s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.945738304 (526h36m28.829692515s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:50.947054123 (526h36m28.831008392s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Uploading piece...
Feb 6 14:31:51.551404309 (526h36m29.435358494s) [upload=463421]: Next returned nil segment
Feb 6 14:31:51.551425282 (526h36m29.435379482s) [upload=463421]: Waiting for error group managing segments...
Feb 6 14:31:51.692165074 (526h36m29.57611928s) [noise=true , address=45.91.116.4:4972 , piece_id=65NEZO4EEGXKE5YYJ6GVUPTPGUHZ6CLXG63D2DUGQ644W5Y42YKA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.693692206 (526h36m29.577646411s) [noise=true , address=45.91.116.4:4955 , piece_id=2AFZACOWP3YFB2XFKROUFLYMMZX3WNVV4PGGQXAXQ7UWCWD3V7MQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.694121668 (526h36m29.578075867s) [noise=true , address=45.91.116.9:4262 , piece_id=PG3JPFXK62MA7KFCPMYNKWKDN3KIUBY4WK5PJVBKNDVK3O42WJNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.704320788 (526h36m29.588274981s) [noise=true , address=45.91.116.12:4244 , piece_id=MG2EQ7IFXZO6KPCSUO4X6HXCPN6HGVZFIFIPIVBDNWR2CLRSW6ZQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.709982886 (526h36m29.593937085s) [noise=true , address=45.91.116.13:4153 , piece_id=FTPTHWNDQ4JSA7NFMTEGBKDJACWQEAR6MYMMUEPZM5UA7JS5ZLNQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.716091355 (526h36m29.600045659s) [noise=true , address=45.91.116.8:4080 , piece_id=3IVFNHD5Y3JPQ3OMB74BQRJCKYSMNUX2RJK4E6JWYDFL3LTEXE6Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:51.724843857 (526h36m29.608798066s) [noise=true , address=45.91.116.14:4192 , piece_id=5W7AAMXQWIR63YXUX5ZG6GSD7GUG2JSHZZ24POH6F3O3D6BUSTPA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:31:53.326122186 (526h36m31.210076386s) [noise=true , address=145.79.227.36:4517 , piece_id=2JZAY3U47VTEHYZLTFP5DNG54WSOIU5F2BNCS6MOTVLBK3FFDWZA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: <nil>
Feb 6 14:32:20.485662904 (526h36m58.369617117s) [noise=true , address=77.90.31.17:4773 , piece_id=LY3XB3YN2NR4D7GE6B6AM7WQXIMYJCDPVIQTKV2YOBEEH2FCALFA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56392->77.90.31.17:4773: use of closed network connection
Feb 6 14:32:20.485796730 (526h36m58.369750932s) [noise=true , address=77.90.31.10:4519 , piece_id=3ZQDGWUKBJSLA7BSM7YSDUBLQU7JDJYI5ZHU7TVN4FCB6SJO34RQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: read tcp 139.59.144.22:54076->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.485945901 (526h36m58.369900107s) [noise=true , address=79.127.219.38:4818 , piece_id=EQATBOUXZMCGSEMVGBLUFO2RES4QAJQEFQCLRLW6SNA26HHWOMQA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12ZvUdXiXPFGqmVzYffAp735GjzaSMcyUfTD61Yi6us9ETg7Ath, address:79.127.219.38:4818): protocol: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40900->79.127.219.38:4818: use of closed network connection
Feb 6 14:32:20.485996958 (526h36m58.369951158s) [noise=true , address=77.90.31.21:4878 , piece_id=QOP73LUNVFROEKH7AHIRBZ7RTPBIPBEASJKX4AMFOH3EEGGFZN4Q, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:35974->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486171103 (526h36m58.37012531s) [noise=true , address=77.90.31.16:4736 , piece_id=O725GZGHAAJRABCZUEJP5W3LUPFYY5HXRV26V453IVND4HQ6X2XA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:56900->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486306758 (526h36m58.370260961s) [noise=true , address=79.127.219.45:4853 , piece_id=QWZYSMIFQKLCMGRN463VTZCK7NKC2MEVUVY6NXJ5OC2IVIFUGTHQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34942->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486488608 (526h36m58.370442813s) [noise=true , address=77.90.31.19:4844 , piece_id=LH7S2DDXMH57DDZCJXHXL5F3JJ6Y2DHBA533MIL3QTBSLSPS6XHA, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: read tcp 139.59.144.22:49178->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486629707 (526h36m58.370583953s) [noise=true , address=77.90.31.14:4661 , piece_id=I5PG6HFUT7T4U4TS4UNPURC5QSXLDRUWSRCU3JOYFRTJWFYFSLEQ, seg_pos={0 0}, upload=463421]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 139.59.144.22:54300->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:32:20.486651465 (526h36m58.37060565s) [seg_pos={0 0}, upload=463421]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 6 14:32:20.597706601 (526h36m58.4816608s) [upload=463421]: Done uploading segments...
Feb 6 14:32:20.597756789 (526h36m58.481710989s) [upload=463421]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 30.113632529s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.412908394s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:31:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.41293281s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X....X...................] duration:
2.404427774s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:30:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.404463479s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.332678689s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:30:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.332707437s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X....X..................] duration:
2.413447167s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:30:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.413475611s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X....X.................] duration:
2.233894269s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:29:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.2339908s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X....X................] duration:
2.378038747s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:29:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.378070112s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.310405175s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:29:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.310548951s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X....X...............] duration:
2.434600638s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:29:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.434660434s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.335978445s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:28:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.336032067s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X....X..............] duration:
2.269583426s trace:
https://jaeger.dev.storj.io/trace/1e569e48a28b86ba
FAIL (2026-02-06 14:27:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
NZXY52XPCA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714172430 (526h23m21.59812662s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714599883 (526h23m21.5985541s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.714979911 (526h23m21.598934114s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.715413590 (526h23m21.599367797s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716226979 (526h23m21.600181189s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.716676921 (526h23m21.60063113s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.718831985 (526h23m21.602786224s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719307901 (526h23m21.603262122s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.719784783 (526h23m21.603738987s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720177177 (526h23m21.60413138s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720622028 (526h23m21.604576234s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.720990963 (526h23m21.604945166s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.721630172 (526h23m21.60558438s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:43.722859314 (526h23m21.606813522s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Uploading piece...
Feb 6 14:18:44.322338184 (526h23m22.206292395s) [upload=463228]: Next returned nil segment
Feb 6 14:18:44.322356588 (526h23m22.206310795s) [upload=463228]: Waiting for error group managing segments...
Feb 6 14:18:44.455763048 (526h23m22.339717239s) [noise=true , address=45.91.116.13:4156 , piece_id=KCUMAGGPUG2VJCGX36JWUMLUUVAXQNY6TN2CWDFFWXNZXY52XPCA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.457244538 (526h23m22.341198746s) [noise=true , address=45.91.116.12:4227 , piece_id=DN2YIJMMHC6VDTVBVOHWBG534X4XS5R26EKQOEWGDXMWLHTYQWNQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.459283209 (526h23m22.343237418s) [noise=true , address=145.79.227.44:4193 , piece_id=RIAXP4L7Q6F7JNCGAVGWNCWKHHYKUCNTF43CWPPKDSREVYSFETEA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.462798718 (526h23m22.346752934s) [noise=true , address=45.91.116.9:4261 , piece_id=RBDTLYSNDYCE2HTOHAOHW6KHAKLFT5AUFF4BQXFBPMPTIGJM23TA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.463703158 (526h23m22.347657345s) [noise=true , address=145.79.227.44:4195 , piece_id=IXOEWLQFDX3VZ56VPG3T5CP6X6NVZ5VMCNACL43TIVOPC5TG55YA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.464661056 (526h23m22.348615268s) [noise=true , address=45.91.116.13:4155 , piece_id=LJCVMWHAJF72OBX3PV2RB3GHEOFET5FW2LEGI7HQ2H26Y674XWTA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:18:44.492358843 (526h23m22.376313033s) [noise=true , address=45.91.116.12:4255 , piece_id=YRPUMWFU63NQPWPJ75XBM2UWEQC3XG57U3PRE6PZKD52H6FZCH6Q, seg_pos={0 0}, upload=463228]: Done uploading piece. err: <nil>
Feb 6 14:19:13.290042898 (526h23m51.173997109s) [noise=true , address=77.90.31.14:4661 , piece_id=KFYS2EZGZEEB2H2XZVRBX2RXEY7EO5LNW4N42WA75XDBNIASUAJA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52262->77.90.31.14:4661: use of closed network connection
Feb 6 14:19:13.290301658 (526h23m51.174255869s) [noise=true , address=77.90.31.16:4736 , piece_id=77XBI5WPTPR2P6DLNMALE5JFNBWLU2FEC4OMLSZNB2VQBU6X7FCQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290338511 (526h23m51.174292755s) [noise=true , address=79.127.219.45:4857 , piece_id=5GI53OJXFO3BEOXDGCESVNMQMQBHCHIIKDNZQ2HRZJ374NTXXBEQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12FepZcDa32utRVSVgZ2uaxpFjJsGDnikXKBugBqR91Dc93nxKp, address:79.127.219.45:4857): protocol: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54228->79.127.219.45:4857: use of closed network connection
Feb 6 14:19:13.290485796 (526h23m51.174440008s) [noise=true , address=77.90.31.21:4877 , piece_id=3HAYGPW3RSPZM2KPVZOI7QO4GU5KQF5PN36KH7NDVJPU2ASDWUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49910->77.90.31.21:4877: use of closed network connection
Feb 6 14:19:13.290540765 (526h23m51.174494975s) [noise=true , address=77.90.31.15:4700 , piece_id=DJQXYSXXD32A2AHD6NIKYKR2BPNQGJ7SOVRIMBH4YPCNQFMPQB5A, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: expected piece hash; context deadline exceeded; EOF
Feb 6 14:19:13.290648007 (526h23m51.174602229s) [noise=true , address=79.127.219.38:4822 , piece_id=FMH54EATB5FPHACL437DYMQ56PPKY2VD6HXNIFBOTJ5DGDIAAQZA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1o271sgebi4h8buaYAQW1YcwjT5AuTrj2M3SRf86d8qJLSy8Mn, address:79.127.219.38:4822): protocol: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59132->79.127.219.38:4822: use of closed network connection
Feb 6 14:19:13.290780414 (526h23m51.174734625s) [noise=true , address=77.90.31.19:4841 , piece_id=N2DOZOD4NBDWQQJIG6W26J3JUPPSMSK5CBTWUQEJVLDX3UGTCKRQ, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52806->77.90.31.19:4841: use of closed network connection
Feb 6 14:19:13.290940941 (526h23m51.174895147s) [noise=true , address=77.90.31.10:4519 , piece_id=E4PBRSBZMQTUBS4R3AXOKKDHDI5EYXELXBPLPQEPL5KC5ICPUUWA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59702->77.90.31.10:4519: use of closed network connection
Feb 6 14:19:13.291348971 (526h23m51.175303192s) [noise=true , address=77.90.31.21:4878 , piece_id=XQF33W4NRZB6Z3PPXUQRKDUUV2Q4ZDU5XUSNV7HH5YWTBPUFT5KA, seg_pos={0 0}, upload=463228]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 139.59.144.22:59638->77.90.31.21:4878: use of closed network connection; context deadline exceeded
Feb 6 14:19:13.291397628 (526h23m51.175351815s) [seg_pos={0 0}, upload=463228]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Feb 6 14:19:13.398113698 (526h23m51.282067911s) [upload=463228]: Done uploading segments...
Feb 6 14:19:13.398162080 (526h23m51.282116294s) [upload=463228]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 2.269682755s
core
uplink
us-select-1
|