Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................X.......................] duration: 1.672978094s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-05 00:01:11 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.673014707s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................X......................] duration: 1.634866112s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:59:59 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.63496641s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................X.....................] duration: 1.554768974s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:59:22 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.55480436s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................X....................] duration: 2.215769419s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:58:43 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 2.2157911s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................................X...................] duration: 1.710231069s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:57:40 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.710276703s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................X..................] duration: 1.638638253s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:56:57 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.638663308s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................X.................] duration: 2.109127454s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:55:44 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 2.109156919s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................X................] duration: 2.100709775s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:54:46 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 2.100739934s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............................................X...............] duration: 2.162661191s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:54:03 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 2.162691722s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............................................X..............] duration: 1.596929426s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:52:52 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.59695263s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............................................X.............] duration: 1.567921996s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:51:46 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.568017409s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............................................X............] duration: 1.555955238s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:50:52 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.556006184s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................................................X...........] duration: 1.530773104s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:50:06 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.530876343s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................................................X..........] duration: 2.103456212s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:49:22 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 2.103492347s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................................................X.........] duration: 1.604056869s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:48:34 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.604090448s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................................................X........] duration: 1.645277402s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:47:27 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.645302192s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................................X.......] duration: 2.092219341s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:46:39 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 2.092256409s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................................X......] duration: 1.574393005s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:45:28 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.574424987s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................................X.....] duration: 2.060840486s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:44:46 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 2.060922943s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................................X....] duration: 2.1515873s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:44:01 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 2.151640859s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................................................X...] duration: 1.534089004s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:43:14 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.534141583s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................................X..] duration: 2.062831459s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:42:33 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 2.062860159s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................................X.] duration: 1.557546812s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:41:20 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.557577492s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 5.000865626s trace: https://jaeger.dev.storj.io/trace/5642e74845148732 FAIL (2026-04-04 23:40:14 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 5.000891357s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.294134872s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:38:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.294178943s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.368087637s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:37:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.368124402s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.376281207s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:37:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.376311944s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.502619659s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:37:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.502668067s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.41031725s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:36:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.41035215s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.467461197s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:35:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.467505772s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.451491949s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:34:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.451534566s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.620876282s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:34:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.620960898s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.446112184s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:33:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.446142829s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.401403255s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:32:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.401437167s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.502048653s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:31:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.502086639s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.497048746s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:30:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.497082688s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.771361516s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:30:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.77139897s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.38171566s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:28:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.381768258s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.378043446s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:27:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.37807255s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.290424881s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:26:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.290462406s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.340503583s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:26:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.340533s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.526122349s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:25:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.526154298s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.416391826s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:24:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.416426688s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.449612668s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:24:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.449644588s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.748003527s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:23:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.748053012s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.666666074s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:22:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.666696764s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.426039714s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:21:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.426076117s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.343652522s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:20:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.343685406s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.44062583s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:19:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.44068818s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.474403613s trace: https://jaeger.dev.storj.io/trace/290787ca54bebb FAIL (2026-04-04 11:18:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Apr 4 10:53:46.206815541 (594h42m49.222485149s) [upload=571082]: Starting upload Apr 4 10:53:46.206940671 (594h42m49.222610275s) [upload=571082]: Done starting upload Apr 4 10:53:46.207036329 (594h42m49.22270592s) [upload=571082]: Uploading segments... Apr 4 10:53:46.207469846 (594h42m49.223139447s) [upload=571082]: Got next segment. Inline: false Apr 4 10:53:46.207553519 (594h42m49.223223127s) [upload=571082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 10:53:46.207593952 (594h42m49.223263556s) [upload=571082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 10:53:46.316863315 (594h42m49.332532916s) [seg_pos={0 0}, upload=571082]: Begin upload segment... Apr 4 10:53:46.317599710 (594h42m49.333269321s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.321364955 (594h42m49.337034606s) [seg_pos={0 0}, upload=571082]: Done begin upload segment. Apr 4 10:53:46.321449165 (594h42m49.337118771s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322092052 (594h42m49.337761661s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.322587882 (594h42m49.338257485s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323912483 (594h42m49.339582094s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.323985471 (594h42m49.339655078s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325500872 (594h42m49.341170485s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.325523739 (594h42m49.341193349s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327269027 (594h42m49.342938629s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.327439117 (594h42m49.343108728s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.328705164 (594h42m49.344374767s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.329399528 (594h42m49.345069139s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.330188319 (594h42m49.345857921s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.331165353 (594h42m49.346834964s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333029974 (594h42m49.348699583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.333131519 (594h42m49.348801127s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Uploading piece... Apr 4 10:53:46.928772929 (594h42m49.944442529s) [upload=571082]: Next returned nil segment Apr 4 10:53:46.928791869 (594h42m49.944461481s) [upload=571082]: Waiting for error group managing segments... Apr 4 10:53:47.071678672 (594h42m50.087348273s) [noise=true , address=45.91.116.11:4119 , piece_id=S3ZU6MLL6TJZZSPRHFJLCIYGWHKNWGDCUVKK3ZJ3O7Q5YWJNGHZA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.072448226 (594h42m50.088117827s) [noise=true , address=45.91.116.14:4190 , piece_id=EREFZ55ZCXXDTLS3VX7ILPRKZCR6APYKQRPEILSAXIPFD5QKEQAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.077523885 (594h42m50.093193495s) [noise=true , address=77.90.31.14:4661 , piece_id=2V5TVSMNYG37HOTSSLCMFTC2EKPHNIKHAD4HMYKG7BPB2ZMXKXNQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:47.089475683 (594h42m50.105145273s) [noise=true , address=45.91.116.10:4081 , piece_id=5UQET7F7FUJWY2C44GPGGGN6ZZFI53CZ5G7MOMMBFTNV6G6AO5MA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:48.594572671 (594h42m51.610242282s) [noise=true , address=145.79.227.20:4441 , piece_id=5CA6MDO52P7P4WDMG6S5ORW5F5VGXDFUFDIXNVUFIKI3FHXWTPSA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:51.360875972 (594h42m54.376545583s) [noise=true , address=145.79.227.21:4478 , piece_id=SKR3H5WX64KK4JHQZILBWGKBNUEZT2VXMGV7N2UUIBB5JJQ4LM3Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:52.651600247 (594h42m55.667269847s) [noise=true , address=145.79.227.37:4567 , piece_id=DMI5FNQE6JZ476QGXF2DJXL5KDBL3TVCITH3QYXYKRYYT2VN43OA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.148816517 (594h42m58.164486121s) [noise=true , address=145.79.227.4:4186 , piece_id=M2PSUJVKWQLJK7KXKNVFAGRVPH573GDXHSF5U656GX6Q5XQCOWBQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:55.792024143 (594h42m58.807693742s) [noise=true , address=145.79.227.39:4018 , piece_id=C7CAWH5NELFRZK7MG5XFV2HYMRN5YU3MAKX2JUUCW5XD2YBVVHQQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:53:58.300223601 (594h43m1.315893196s) [noise=true , address=145.79.227.3:4152 , piece_id=VTI45NEVOH4FQKDC3VH6SIB5FTQTIKLYCLD6VN2ZTHYHAO554QTQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:05.278507622 (594h43m8.294177234s) [noise=true , address=145.79.227.34:4905 , piece_id=JXFDO7V64FM55CXDPXKVZPWF6GCIYA5JBYVSQM4HUH67BBI6MXFQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: <nil> Apr 4 10:54:15.915612081 (594h43m18.931281691s) [noise=true , address=145.79.227.17:4972 , piece_id=BQCLEFLTQLRNIGU7EKZDD2SE65HCKL4DYX2DWCGGGXV6PIIEPKAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.915961646 (594h43m18.931631257s) [noise=true , address=145.79.227.48:4301 , piece_id=TO45JWTK2ALEADHXAUJTPGSHUKU65TJNANGJQUW25K7MPUF6D34Q, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:18HkaSrdHHnvmeNz1ormfcSBZH8bMUgkX7X3JmGuqkmtBoak29, address:145.79.227.48:4301): protocol: read tcp 139.59.144.22:58302->145.79.227.48:4301: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916022609 (594h43m18.931692219s) [noise=true , address=145.79.227.11:4732 , piece_id=X36LCIP62WJFQZXVBE6RDD6LU3QZD76EXSL3BJOTUACOIHTXK5UA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: read tcp 139.59.144.22:45366->145.79.227.11:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916218533 (594h43m18.931888146s) [noise=true , address=145.79.227.8:4333 , piece_id=5N4SJKE5YRCBY7V6MQX44EIXIPWW5HHIJ3DNDXIEV2I4SZP2RYAQ, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: read tcp 139.59.144.22:56098->145.79.227.8:4333: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916347198 (594h43m18.932016809s) [noise=true , address=145.79.227.2:4115 , piece_id=OQQMIUFZ765ZWORSDNL24R4B6AK6UD4XSVZI62ZPNJ7D2KHPUQCA, seg_pos={0 0}, upload=571082]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: read tcp 139.59.144.22:43982->145.79.227.2:4115: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 10:54:15.916400114 (594h43m18.932069716s) [seg_pos={0 0}, upload=571082]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Apr 4 10:54:16.021957736 (594h43m19.037627363s) [upload=571082]: Done uploading segments... Apr 4 10:54:16.022001743 (594h43m19.037671354s) [upload=571082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.474644035s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)