Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................................X...................] duration:
1.737202117s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 20:02:02 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.737249284s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................................X..................] duration:
1.69013446s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 20:00:53 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.690159585s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................................X.................] duration:
1.697807902s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 20:00:25 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.69783626s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................................X................] duration:
2.091091124s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:59:12 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.09111755s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............................................X...............] duration:
1.673607164s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:58:21 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.673629633s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............................................X..............] duration:
1.729325398s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:57:25 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.729350979s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............................................X.............] duration:
1.675244144s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:56:32 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.675281448s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............................................X............] duration:
1.612144097s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:55:20 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.612186523s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................................................X...........] duration:
1.675133488s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:54:08 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.675158971s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................................................X..........] duration:
1.686517826s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:53:49 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.686546841s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................................................X.........] duration:
1.612182263s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:52:59 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.612214416s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................................................X........] duration:
2.076738559s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:52:06 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.076763727s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................................................X.......] duration:
1.669146407s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:50:59 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.669177685s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................................................X......] duration:
1.746716249s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:50:34 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.746741502s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................................................X.....] duration:
1.730141057s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:49:29 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.730172695s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................................................X....] duration:
1.733450575s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:48:27 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.733486438s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................................................X...] duration:
1.656602413s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:47:55 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.656630599s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..] duration:
1.676510173s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:47:08 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.676536249s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.] duration:
2.187715696s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:46:00 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.187738815s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X] duration:
5.000598362s trace:
https://jaeger.dev.storj.io/trace/460a966581e339c4
FAIL (2026-02-05 19:45:36 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 5.000625181s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.417146306s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:45:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.417179257s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.424779043s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:44:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.424807935s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.523374099s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:44:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.523469932s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.498562614s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:43:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.498599997s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [X...X.......................................................] duration:
2.468945685s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:42:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.468972324s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [XX...X......................................................] duration:
2.572513072s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:42:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.572544729s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.XX...X.....................................................] duration:
2.526952796s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:41:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.526985704s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..XX...X....................................................] duration:
2.428489713s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:40:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.428551183s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [X..XX...X...................................................] duration:
2.570552611s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:39:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.570580441s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X..XX...X..................................................] duration:
2.444854133s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:38:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.444971955s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X..XX...X.................................................] duration:
2.440346035s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:38:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.440379177s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X..XX...X................................................] duration:
2.444098367s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:38:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.444130376s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X..XX...X...............................................] duration:
2.50106631s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:37:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.501100345s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X..XX...X..............................................] duration:
2.5441024s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:36:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.544156305s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X..XX...X.............................................] duration:
2.457522477s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:35:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.457542948s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X..XX...X............................................] duration:
2.462314733s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:34:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.462557656s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X..XX...X...........................................] duration:
2.489277571s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:33:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.489308261s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X..XX...X..........................................] duration:
2.501846856s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:32:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.501877205s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........X..XX...X.........................................] duration:
2.445776624s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:31:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.445803044s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........X..XX...X........................................] duration:
2.489272594s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:31:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.489426323s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [............X..XX...X.......................................] duration:
2.455089443s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:30:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.455119305s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............X..XX...X......................................] duration:
2.427093755s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:29:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.427182759s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............X..XX...X.....................................] duration:
2.399629652s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:29:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.399721263s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............X..XX...X....................................] duration:
2.389983719s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:28:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.3900178s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [................X..XX...X...................................] duration:
2.426400957s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:27:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.426424183s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................X..XX...X..................................] duration:
2.429309936s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:27:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.429338322s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................X..XX...X.................................] duration:
2.427592008s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:26:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.427618737s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................X..XX...X................................] duration:
2.630718646s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:25:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.630790047s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................X..XX...X...............................] duration:
2.371335951s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:24:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.371363387s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................X..XX...X..............................] duration:
2.497810873s trace:
https://jaeger.dev.storj.io/trace/3901c8c78823605f
FAIL (2026-02-05 17:23:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
item: *pb.BatchRequestItem_SegmentBegin
Feb 5 17:02:11.854806994 (505h6m49.738761202s) [seg_pos={0 0}, upload=444526]: Begin upload segment...
Feb 5 17:02:11.854900772 (505h6m49.738854977s) [seg_pos={0 0}, upload=444526]: Done begin upload segment.
Feb 5 17:02:11.854954936 (505h6m49.73890916s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.854978757 (505h6m49.738932969s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855733938 (505h6m49.739688149s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.855803981 (505h6m49.739758189s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.856561049 (505h6m49.740515258s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.857243778 (505h6m49.741197983s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858328524 (505h6m49.742282726s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.858408717 (505h6m49.742362919s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859283893 (505h6m49.743238102s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.859349451 (505h6m49.743303664s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860429890 (505h6m49.744384103s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.860749829 (505h6m49.744704058s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861189248 (505h6m49.745143458s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.861807907 (505h6m49.745762119s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.862454596 (505h6m49.746408807s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:11.863008966 (505h6m49.746963177s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Uploading piece...
Feb 5 17:02:12.487708220 (505h6m50.37166241s) [upload=444526]: Next returned nil segment
Feb 5 17:02:12.487749201 (505h6m50.37170341s) [upload=444526]: Waiting for error group managing segments...
Feb 5 17:02:12.615844151 (505h6m50.49979834s) [noise=true , address=45.91.116.14:4196 , piece_id=QX73K2D2ZA7QHLVCNT2GHNUOH5OMTXTQRV7UZKF7WYN6STGGRYDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.623859028 (505h6m50.507813228s) [noise=true , address=45.91.116.5:4332 , piece_id=VI24VMUCQWMUTX75OVHF4PL6NS7HJIGO3O33RZCBWDYQGTN4DPAQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.624724642 (505h6m50.508678847s) [noise=true , address=45.91.116.11:4120 , piece_id=6DUEUPZAGFLGH32HFBOTNYYNJNEBNTU2KAUY34HIX7QIZRNQPGWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.625720125 (505h6m50.509674325s) [noise=true , address=45.91.116.12:4244 , piece_id=K35C2HYWWHGRJOVWVAZSGLQ7WRULTVYLTIBPE5GODCJ6OUA4J3KA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.626584773 (505h6m50.510538973s) [noise=true , address=45.91.116.6:4980 , piece_id=N74WAAAM5VKZGUATSSUKQQ57GB2HDX2VR477QUPVMEW4Y5KOC7BQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.633044253 (505h6m50.516998453s) [noise=true , address=45.91.116.4:4955 , piece_id=G4F6HMEXIO3JFTY54H6A42DI3QGHWXVTO4SZ3OWB35RK6MFUBGJQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.646705823 (505h6m50.530660025s) [noise=true , address=145.79.227.26:4653 , piece_id=TANR2Y5MLDLB6Y6LO2J2L5JGXKEDZ4KL6X7B2ROPL22346FMUBEA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:12.666757721 (505h6m50.550711922s) [noise=true , address=145.79.227.35:4482 , piece_id=NVG3ZRFW3UKXRL2KJTPDMST7BGP4RROQBHNPB5ZQ7L5PTP7SJA4Q, seg_pos={0 0}, upload=444526]: Done uploading piece. err: <nil>
Feb 5 17:02:41.406142036 (505h7m19.29009624s) [noise=true , address=79.127.219.38:4821 , piece_id=AI2T2VLSTBF7IATUDEX5RVBIFIA7QAPKLOQBLBZCWIUH2A7SGFDQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1dddh1fFmpikhiAvNuy9x3f53HRnrCNVTnwLU6yCFLezdp1e1r, address:79.127.219.38:4821): protocol: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45252->79.127.219.38:4821: use of closed network connection
Feb 5 17:02:41.406480707 (505h7m19.290434916s) [noise=true , address=79.127.219.45:4853 , piece_id=VYGUWI2DN44QKDRSYDPNHCXGZDUPAWFJNXSUTDJIG4LPMYYC6PDA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12WgUVB2RPUrcgq3FtMLtiosqUhAGWSXnsynT7iZZnaiokgJsEP, address:79.127.219.45:4853): protocol: read tcp 139.59.144.22:34464->79.127.219.45:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406544360 (505h7m19.29049857s) [noise=true , address=77.90.31.17:4773 , piece_id=VS7IFMG2SFXNXSEWUWVVSFO5BHODUNCUHUT6ESRZKNNJ2ZFM4ZRA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ, address:77.90.31.17:4773): protocol: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40258->77.90.31.17:4773: use of closed network connection
Feb 5 17:02:41.406746766 (505h7m19.290700986s) [noise=true , address=79.127.219.46:4893 , piece_id=FYIU3ABFZFIGJ7QH2QLQFUDSYUWGNGPNDSAC75KDE4RLZVIZTKXA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12GACGh4mG21dqC9x8JfPKSDB96KU1RDQrsFePfREa4Fg3dLmwp, address:79.127.219.46:4893): protocol: read tcp 139.59.144.22:50490->79.127.219.46:4893: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.406958730 (505h7m19.290912943s) [noise=true , address=79.127.219.41:4930 , piece_id=VT76FYTDYY5ZKTMV5ZJAE7UXB23OJILN3FBTQEJJHN6NXWZHUSWA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:12A39mM8Cc7tERvweTDoj4wkGgNTNn2QafEkMhn8PV1rwREj8WP, address:79.127.219.41:4930): protocol: read tcp 139.59.144.22:48696->79.127.219.41:4930: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407215901 (505h7m19.29117011s) [noise=true , address=77.90.31.18:4808 , piece_id=2BZEOWOEH3VTB3BUYHRSUEEZCIYXPKLYILTXITYPCNPE2EFJSQVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: read tcp 139.59.144.22:52118->77.90.31.18:4808: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407253051 (505h7m19.291207263s) [noise=true , address=77.90.31.17:4770 , piece_id=XDF7OEMMJCYG7WI64ARZ4RCIDII5KEKYC5COAV7EXEDE42DYDFUA, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:60186->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407544318 (505h7m19.291498524s) [noise=true , address=77.90.31.11:4554 , piece_id=OEJWE5QJREDOVM2PNWQGZDE3FAQWN4TSHUX4I7NVAEWAVPP2HMVQ, seg_pos={0 0}, upload=444526]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 139.59.144.22:56436->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 5 17:02:41.407583464 (505h7m19.291537659s) [seg_pos={0 0}, upload=444526]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Feb 5 17:02:41.518182072 (505h7m19.40213628s) [upload=444526]: Done uploading segments...
Feb 5 17:02:41.518239329 (505h7m19.402193542s) [upload=444526]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 2.497841272s
core
uplink
us-select-1
|