Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X.........X.........X...........................] duration:
2.460957313s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 15:06:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.460993147s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X.........X.........X..........................] duration:
2.383228796s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 15:05:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.383256777s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.39791216s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 15:05:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.397940608s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X.........X.........X.........................] duration:
2.519454573s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 15:05:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.519481212s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.302677421s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 15:05:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.302705232s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X.........X.........X........................] duration:
2.424450786s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 15:04:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.424478474s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.466055158s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 15:04:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.466079065s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X.........X.........X.......................] duration:
2.441439597s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 15:03:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.441465821s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.329336539s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 15:03:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.329368921s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X.........X.........X......................] duration:
2.516169952s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 15:03:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.5162259s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.453136988s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 15:02:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.453155566s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X.........X.........X.....................] duration:
2.4241645s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 15:02:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.42419332s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X.........X.........X....................] duration:
2.354229064s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 15:01:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.354255953s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.278198495s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 15:01:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.278223358s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [X...................X.........X.........X...................] duration:
2.398791221s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 15:00:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.398819545s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.582662302s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 15:00:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.582695529s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X...................X.........X.........X..................] duration:
2.380402529s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:59:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.380488109s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X...................X.........X.........X.................] duration:
2.453976954s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:59:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.453991805s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.283761684s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:59:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.283793988s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X...................X.........X.........X................] duration:
2.448569298s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:59:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.448596838s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.407007391s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:58:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.407037614s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X...................X.........X.........X...............] duration:
2.482073979s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:58:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.482105687s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.37052717s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:58:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.370570352s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [X....X...................X.........X.........X..............] duration:
2.438887075s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:57:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.438932347s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X....X...................X.........X.........X.............] duration:
2.466650681s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:57:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.466685304s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.848022626s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:57:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.848054594s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.388178216s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:56:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.388274762s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X....X...................X.........X.........X............] duration:
2.373777723s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:56:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.373816873s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X....X...................X.........X.........X...........] duration:
2.360639257s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:55:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.360668523s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.532458807s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:55:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.532490503s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.380582623s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:55:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.380611151s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [....X....X...................X.........X.........X..........] duration:
2.445710742s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:55:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.445740489s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.522740417s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:54:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.522820429s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....X....X...................X.........X.........X.........] duration:
2.537560033s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:54:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.537652284s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.283058129s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:53:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.283086732s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [......X....X...................X.........X.........X........] duration:
2.341652026s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:52:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.341675592s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.515327329s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:52:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.515370349s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......X....X...................X.........X.........X.......] duration:
2.400775742s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:52:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.400802253s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.329514132s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:51:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.32953481s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [........X....X...................X.........X.........X......] duration:
2.45734771s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:51:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.457376472s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.312122429s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:51:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.312153189s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [.........X....X...................X.........X.........X.....] duration:
2.367412004s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:51:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.36751257s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.439899951s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:50:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.439935515s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [..........X....X...................X.........X.........X....] duration:
2.432005577s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:50:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.432034196s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.372909892s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:50:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.372937473s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........X....X...................X.........X.........X...] duration:
2.36048436s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:49:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.360553444s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [............X....X...................X.........X.........X..] duration:
2.552425814s trace:
https://jaeger.dev.storj.io/trace/5212dfa6cf9707e7
FAIL (2026-02-06 14:48:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.216104566 (526h51m49.100058777s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.217857507 (526h51m49.101811714s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.219468821 (526h51m49.103423024s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.221238075 (526h51m49.105192286s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.222902804 (526h51m49.106857016s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.224553380 (526h51m49.10850759s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.226143540 (526h51m49.110097743s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.227663172 (526h51m49.11161738s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.229485740 (526h51m49.113439952s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Uploading piece...
Feb 6 14:47:11.841725477 (526h51m49.725679664s) [upload=463634]: Next returned nil segment
Feb 6 14:47:11.841743717 (526h51m49.725697921s) [upload=463634]: Waiting for error group managing segments...
Feb 6 14:47:11.980243086 (526h51m49.864197295s) [noise=true , address=45.91.116.9:4264 , piece_id=P62XVNZ7WNYFVZNZ7V7H6A4IOVH3MZXQSVRYI5R2RTUZWNUQAN5Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.984081701 (526h51m49.868035903s) [noise=true , address=45.91.116.6:4976 , piece_id=2Y3ALEVOB774W73B5M5RVARIB65SAKTPAMQISYRSIQV33QVAFU7Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:11.986081042 (526h51m49.870035249s) [noise=true , address=45.91.116.8:4046 , piece_id=7SFML2RLAVR2ENM4ZHUMDD36DFIG3YJZWPVLT234MUGKSAL4BHYA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:12.022216032 (526h51m49.906170239s) [noise=true , address=45.91.116.12:4227 , piece_id=FFJMG47MGDULQZUMGST6XDWAYCWGUEVJQNUWFNZUASET2JGP3LZA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: <nil>
Feb 6 14:47:40.747802340 (526h52m18.631756545s) [noise=true , address=77.90.31.10:4520 , piece_id=SYBDLKZ4EM5GJHSN5PGYMI3CESXGIUQEFX36QXD642GZNMLNJ6YQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38628->77.90.31.10:4520: use of closed network connection
Feb 6 14:47:40.748183818 (526h52m18.632138019s) [noise=true , address=79.127.219.45:4855 , piece_id=WOZLW3D3ID4DTTIXEHDUU47ZQG6PD2Y77KR7WFTJGLZ6NU2RB6BA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12F8wZ3HB6xVSaAcdLtrDAczGmmrbPPMzteKoXq1H8HFs1bXFjH, address:79.127.219.45:4855): protocol: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59222->79.127.219.45:4855: use of closed network connection
Feb 6 14:47:40.748383345 (526h52m18.632337555s) [noise=true , address=79.127.219.41:4926 , piece_id=XULRAQFMLM3ZRESNIBK2ZIIC7I7VRAN5TLDRMXHASVXTA7Q6WYFQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12tJCL7kn8Ko7i1kbN1D8kNGyakuw23pAG5kxsU7LAdikmdmY1s, address:79.127.219.41:4926): protocol: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46114->79.127.219.41:4926: use of closed network connection
Feb 6 14:47:40.748533164 (526h52m18.632487375s) [noise=true , address=77.90.31.11:4555 , piece_id=DD7QIU3FPG3ELL3R6TUQS7WTVUJRIPBSLIOI63BKAQDSJ3COJ5UA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53102->77.90.31.11:4555: use of closed network connection
Feb 6 14:47:40.748641112 (526h52m18.632595321s) [noise=true , address=79.127.219.46:4894 , piece_id=G42IW65LWX73YM4SUL4LTWLJWXIBKDWZJ4QL5SGX2DLUOHOGYCWQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1uawFim4D6QUNemXqXjXFUWtSkMZd6TgZuHEgmc8cXS8Qttqqk, address:79.127.219.46:4894): protocol: read tcp 139.59.144.22:49322->79.127.219.46:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.748741327 (526h52m18.632695533s) [noise=true , address=77.90.31.15:4700 , piece_id=NHPBQU67JUCZ3SCSLTBNANLGXE5QXFPEZKTGW2KZ3CSOEMVQMDOQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:124p2J9pP2rYD3cM73PQNEp6Ykgmpq2xi6aK8wnC6JTiLvHRb7q, address:77.90.31.15:4700): protocol: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52446->77.90.31.15:4700: use of closed network connection
Feb 6 14:47:40.748838914 (526h52m18.632793125s) [noise=true , address=77.90.31.13:4626 , piece_id=PLQVKIGDB7WLOOU4DKOHGPWR4JEQI32D5RV2NJDS5GJDJJ6SR54Q, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54884->77.90.31.13:4626: use of closed network connection
Feb 6 14:47:40.748996001 (526h52m18.632950211s) [noise=true , address=77.90.31.19:4841 , piece_id=TIMN6EMIEC5GVLYZK6ZJ33KEABA3BZLHYYS36QYL3KI643KTWBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 139.59.144.22:48686->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749483529 (526h52m18.633437721s) [noise=true , address=77.90.31.15:4697 , piece_id=EKLGPI5J2UG2M56FHTCJR43XZZRUD246FJNQAYKBBDXQJZS6BDKA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:46836->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.749726695 (526h52m18.633680906s) [noise=true , address=79.127.219.38:4821 , piece_id=JYTOUDKE4F64FJQJ22PAE5T5RNEDDRXF25SQ5SYTHM5FJ4X4QOXQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: read tcp 139.59.144.22:44032->79.127.219.38:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750142194 (526h52m18.634096406s) [noise=true , address=77.90.31.17:4770 , piece_id=NQYWENJ3TIEUZBVK6ZFRLQGWQNKHDE2KC3H4IX6KN7UVZAWONKIQ, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:38876->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750234254 (526h52m18.634188465s) [noise=true , address=77.90.31.14:4663 , piece_id=WIEIHC3W6CLFOAZEVTMMZ3GIMKW4OBSJZI3O56E4XK235RSRIBAA, seg_pos={0 0}, upload=463634]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:45828->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:47:40.750297314 (526h52m18.634251519s) [seg_pos={0 0}, upload=463634]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Feb 6 14:47:40.860681203 (526h52m18.744635405s) [upload=463634]: Done uploading segments...
Feb 6 14:47:40.860727725 (526h52m18.74468193s) [upload=463634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 2.552466179s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.417453446s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:48:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.417476511s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.348695036s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:48:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.348714782s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
58.043479246s trace:
https://jaeger.dev.storj.io/trace/106955ce66edc42
FAIL (2026-02-06 14:47:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
nt.
Feb 6 14:18:56.170543045 (526h23m34.05449725s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170557468 (526h23m34.054511677s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.170756912 (526h23m34.054711112s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171167455 (526h23m34.055121657s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171423042 (526h23m34.055377242s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171583460 (526h23m34.055537664s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171926552 (526h23m34.05588076s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.171968205 (526h23m34.055922411s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172348919 (526h23m34.056303129s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172363790 (526h23m34.056317995s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172747295 (526h23m34.0567015s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.172851984 (526h23m34.056806172s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173216755 (526h23m34.057170963s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173475209 (526h23m34.057429408s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.173868019 (526h23m34.057822218s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174327715 (526h23m34.058281914s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.174785809 (526h23m34.058740019s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.175319330 (526h23m34.059273517s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Uploading piece...
Feb 6 14:18:56.724146418 (526h23m34.608100609s) [upload=463231]: Next returned nil segment
Feb 6 14:18:56.724170751 (526h23m34.60812496s) [upload=463231]: Waiting for error group managing segments...
Feb 6 14:18:56.868839115 (526h23m34.752793314s) [noise=true , address=145.79.227.3:4152 , piece_id=JZ57JJIFEIBX3GUXEVYQAJDKKAC4JSDTCQG7YTQ3ROEPPWZJWZ5Q, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.877225945 (526h23m34.761180146s) [noise=true , address=45.91.116.7:4033 , piece_id=EBVYY4AAU3LFZ4L6HCAPLVGZGGYOCGHP4E75PQZEIDUKGYRZHBKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:56.885951375 (526h23m34.769905581s) [noise=true , address=45.91.116.12:4242 , piece_id=AJ2PSDG23YD44PX3AKA32H6K2WJR22HGFZAHEGNCAOZ2OJOW2EAQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.413580260 (526h23m35.297534463s) [noise=true , address=64.49.13.140:4516 , piece_id=MWSSWCCC3KDNN42CYQBRLMSBZPTNAHL4CGUDFNUXVEJMWJM3OLHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:18:57.425775654 (526h23m35.309729843s) [noise=true , address=64.49.13.27:4968 , piece_id=K2ESE4PBRSGH46TDDQPB3NNVIBYPLHPI5RM6ZAF776BLTO5DCXHA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:13.965867748 (526h23m51.849821948s) [noise=true , address=77.90.31.10:4546 , piece_id=QIDDQBBZPTPEHJBKG2FFI4BMSATFNL5TQQ4ME5RXGXNBGPCFWDNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.327615992 (526h24m23.211570191s) [noise=true , address=77.90.31.15:4721 , piece_id=LFRH2FAXUOTHUJKSYQQCHZQ3IGPKBWUIEQIXQTGMS4ZHO3DTIRJQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:45.663144801 (526h24m23.547099s) [noise=true , address=77.90.31.12:4617 , piece_id=XVY2Q7QVJVMDLEBOBNWAKIX5HCO4RJMZJUOYBX7KTENFPQT7ZQKA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.523442065 (526h24m24.407396265s) [noise=true , address=77.90.31.11:4588 , piece_id=X6Q3UIFI7AGMFQHHDDT52J4UB57FIEVVACVIZBXTESMAL5ARNCIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:46.527908995 (526h24m24.411863194s) [noise=true , address=77.90.31.21:4911 , piece_id=YRY7EZVEXGXRJ5PRY3I6GI4S2D55ADAV4CHWMLS7AO7BD3YH63DQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:47.081264845 (526h24m24.965219045s) [noise=true , address=79.127.219.45:4860 , piece_id=2TBPPP3L475KCUDHJMXMZ3DEYNOHDDWHCAKTSLLKXMBZKD4RQ7DA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:48.337814438 (526h24m26.221768638s) [noise=true , address=77.90.31.19:4861 , piece_id=ZL7JNPSMQ7USQOOJ3AGM4MKT37VP7OWI2TSKJHFPUKCVQHJWBBNQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.162934511 (526h24m33.046888723s) [noise=true , address=77.90.31.18:4811 , piece_id=V3DEDIAEFUV3EJ4D4MLA6CYXBWEQ37BQWIQN54O256DEJOPOPIZA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: <nil>
Feb 6 14:19:55.784024469 (526h24m33.667978673s) [noise=true , address=79.127.219.46:4924 , piece_id=T776DRTA4RJB5LLSHSH7LWHZUXRM5D6PBBHXVABZEFGVZBCBUXEA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12i8YxaLd1NA9zT7u36m7G7YVdGo99TegxqLEFHXNmGCkz8A3ZN, address:79.127.219.46:4924): protocol: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34136->79.127.219.46:4924: use of closed network connection
Feb 6 14:19:55.784041128 (526h24m33.667995338s) [noise=true , address=77.90.31.17:4787 , piece_id=UFPWPBOWUDH6PKC7LC43G4LSGALXZVVNGKRVZU63DNYDOG4WPWEQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53724->77.90.31.17:4787: use of closed network connection
Feb 6 14:19:55.784299756 (526h24m33.668253959s) [noise=true , address=79.127.219.38:4828 , piece_id=23LI2XCANJQXFLVX4A5EAKGYHSQP3J7PBNAECWT2S3654JB7LRIQ, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:1jtbSaBhCP1rSt4rnnYP9Urja7aALytKYrX2phKVRz3ECc9YUv, address:79.127.219.38:4828): protocol: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42850->79.127.219.38:4828: use of closed network connection
Feb 6 14:19:55.784580879 (526h24m33.668535081s) [noise=true , address=77.90.31.13:4638 , piece_id=FHWRHDXGEXK2ZE342UROTKA672IQFUQM6B4SRDXVCLPHPYKJ3XIA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:14HQS4QNDPnS5W7Ae2XURGNModFwarBsbycx7GUFRmkjvKYdKF, address:77.90.31.13:4638): protocol: read tcp 139.59.144.22:39482->77.90.31.13:4638: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784606611 (526h24m33.668560816s) [noise=true , address=77.90.31.14:4694 , piece_id=IYVWTOOJ2HCQRNWQNAJSXI7AATZSGLEFQHNCWBMRGXEYBJRYCRTA, seg_pos={0 0}, upload=463231]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: read tcp 139.59.144.22:60912->77.90.31.14:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 14:19:55.784667295 (526h24m33.668621495s) [seg_pos={0 0}, upload=463231]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Feb 6 14:19:55.895972018 (526h24m33.779926228s) [upload=463231]: Done uploading segments...
Feb 6 14:19:55.896013508 (526h24m33.779967715s) [upload=463231]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 58.043530882s
core
uplink
us-select-1
us1-placement-20
|