Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 172761 reports (Page 232 of 3456)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
2.263012633s
FAIL (2025-10-07 09:11:40 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 2.263047748s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
1.102818363s
FAIL (2025-10-07 09:11:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.10284906s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
901.794434ms
FAIL (2025-10-07 09:11:21 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 901.833597ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
2.218151732s
FAIL (2025-10-07 09:11:14 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 2.218251158s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
969.247554ms
FAIL (2025-10-07 09:10:58 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 969.281287ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
2.184580271s
FAIL (2025-10-07 09:10:24 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 2.1846271s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
1.137842556s
FAIL (2025-10-07 09:10:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.138751732s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
973.694048ms
FAIL (2025-10-07 09:09:52 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 973.760459ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
1.133564786s
FAIL (2025-10-07 09:09:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.13364946s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
2.108310372s
FAIL (2025-10-07 09:09:34 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 2.108348438s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
955.707528ms
FAIL (2025-10-07 09:09:25 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 955.747303ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
1.206082696s
FAIL (2025-10-07 09:08:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.206114927s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
2.298521862s
FAIL (2025-10-07 09:08:35 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 2.298556658s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
1.10064128s
FAIL (2025-10-07 09:08:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.100678619s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
889.161154ms
FAIL (2025-10-07 09:08:24 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 889.188684ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
2.268934982s
FAIL (2025-10-07 09:07:34 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 2.268969455s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
1.052214355s
FAIL (2025-10-07 09:07:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.052425507s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
1.897711214s
FAIL (2025-10-07 09:07:15 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 1.897729588s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
970.970031ms
FAIL (2025-10-07 09:07:14 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 971.00266ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
2.120919552s
FAIL (2025-10-07 09:06:56 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 2.120960012s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
1.009923107s
FAIL (2025-10-07 09:06:50 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 1.009954862s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
1.110769198s
FAIL (2025-10-07 09:06:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.110792257s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
990.768669ms
FAIL (2025-10-07 09:06:04 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 990.819195ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
1.093215903s
FAIL (2025-10-07 09:05:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.093264836s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
2.312154644s
FAIL (2025-10-07 09:05:49 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 2.312185767s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
921.517853ms
FAIL (2025-10-07 09:05:30 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 921.566739ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
934.440904ms
FAIL (2025-10-07 09:04:59 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 934.479863ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
1.104032852s
FAIL (2025-10-07 09:04:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.104057349s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
2.147408507s
FAIL (2025-10-07 09:04:47 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 2.147497934s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
2.176005434s
FAIL (2025-10-07 09:04:13 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 2.176033388s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
982.537747ms
FAIL (2025-10-07 09:04:13 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 982.575442ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
2.387893126s
FAIL (2025-10-07 09:04:00 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
5s) [upload=291132]: Uploading segments...
Oct  7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false
Oct  7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment...
Oct  7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment.
Oct  7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807     , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910   , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801   , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803   , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221    , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699     , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873   , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298     , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119    , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150    , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661     , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940     , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293    , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974     , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113    , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257    , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment
Oct  7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments...
Oct  7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298     , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119    , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974     , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661     , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940     , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807     , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699     , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910   , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801   , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803   , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113    , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293    , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection
Oct  7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221    , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection
Oct  7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150    , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection
Oct  7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873   , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection
Oct  7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257    , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection
Oct  7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Oct  7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments...
Oct  7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.388003982s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
1.100717116s
FAIL (2025-10-07 09:03:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.100740319s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
1.274022004s
FAIL (2025-10-07 09:03:32 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 1.274080097s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
2.618007388s
FAIL (2025-10-07 09:03:18 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
5s) [upload=291132]: Uploading segments...
Oct  7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false
Oct  7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment...
Oct  7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment.
Oct  7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807     , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910   , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801   , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803   , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221    , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699     , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873   , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298     , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119    , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150    , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661     , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940     , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293    , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974     , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113    , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257    , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment
Oct  7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments...
Oct  7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298     , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119    , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974     , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661     , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940     , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807     , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699     , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910   , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801   , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803   , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113    , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293    , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection
Oct  7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221    , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection
Oct  7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150    , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection
Oct  7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873   , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection
Oct  7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257    , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection
Oct  7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Oct  7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments...
Oct  7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.61805287s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
2.056488534s
FAIL (2025-10-07 09:03:00 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 2.05652036s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
960.422721ms
FAIL (2025-10-07 09:02:54 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 960.458504ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
2.370763207s
FAIL (2025-10-07 09:02:40 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 2.370795786s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
1.302014873s
FAIL (2025-10-07 09:02:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.302029092s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
2.585002715s
FAIL (2025-10-07 09:02:27 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
5s) [upload=291132]: Uploading segments...
Oct  7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false
Oct  7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment...
Oct  7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment.
Oct  7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807     , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910   , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801   , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803   , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221    , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699     , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873   , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298     , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119    , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150    , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661     , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940     , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293    , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974     , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113    , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257    , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment
Oct  7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments...
Oct  7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298     , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119    , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974     , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661     , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940     , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807     , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699     , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910   , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801   , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803   , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113    , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293    , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection
Oct  7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221    , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection
Oct  7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150    , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection
Oct  7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873   , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection
Oct  7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257    , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection
Oct  7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Oct  7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments...
Oct  7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.585039661s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
2.665600882s
FAIL (2025-10-07 09:02:20 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 2.66565559s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
946.388661ms
FAIL (2025-10-07 09:01:48 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 946.415554ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
2.461756647s
FAIL (2025-10-07 09:01:38 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
5s) [upload=291132]: Uploading segments...
Oct  7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false
Oct  7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment...
Oct  7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment.
Oct  7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807     , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910   , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801   , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803   , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221    , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699     , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873   , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298     , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119    , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150    , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661     , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940     , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293    , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974     , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113    , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257    , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment
Oct  7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments...
Oct  7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298     , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119    , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974     , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661     , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940     , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807     , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699     , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910   , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801   , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803   , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113    , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293    , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection
Oct  7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221    , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection
Oct  7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150    , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection
Oct  7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873   , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection
Oct  7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257    , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection
Oct  7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Oct  7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments...
Oct  7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.461807442s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
2.73041362s
FAIL (2025-10-07 09:01:36 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 2.730446811s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
1.175114612s
FAIL (2025-10-07 09:01:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.175170502s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
993.560841ms
FAIL (2025-10-07 09:01:10 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 993.617301ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
2.940850103s
FAIL (2025-10-07 09:01:08 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
5s) [upload=291132]: Uploading segments...
Oct  7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false
Oct  7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment...
Oct  7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment.
Oct  7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807     , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910   , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801   , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803   , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221    , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699     , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873   , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298     , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119    , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150    , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661     , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940     , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293    , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974     , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113    , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257    , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment
Oct  7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments...
Oct  7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298     , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119    , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974     , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661     , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940     , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807     , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699     , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910   , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801   , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803   , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113    , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293    , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection
Oct  7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221    , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection
Oct  7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150    , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection
Oct  7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873   , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection
Oct  7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257    , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection
Oct  7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Oct  7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments...
Oct  7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.940904593s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
2.491972939s
FAIL (2025-10-07 09:00:45 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
5s) [upload=291132]: Uploading segments...
Oct  7 08:20:45.408939410 (330h50m33.212404008s) [upload=291132]: Got next segment. Inline: false
Oct  7 08:20:45.408993506 (330h50m33.212458104s) [upload=291132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct  7 08:20:45.409000346 (330h50m33.212464942s) [upload=291132]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct  7 08:20:45.519619793 (330h50m33.323084391s) [seg_pos={0 0}, upload=291132]: Begin upload segment...
Oct  7 08:20:45.519708774 (330h50m33.323173365s) [seg_pos={0 0}, upload=291132]: Done begin upload segment.
Oct  7 08:20:45.519760868 (330h50m33.323225459s) [noise=true , address=77.90.31.18:4807     , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.520346701 (330h50m33.323811292s) [noise=true , address=145.79.227.16:4910   , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.520944808 (330h50m33.324409401s) [noise=true , address=145.79.227.13:4801   , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521117895 (330h50m33.324582486s) [noise=true , address=145.79.227.13:4803   , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521407350 (330h50m33.324871951s) [noise=true , address=145.79.227.5:4221    , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521522186 (330h50m33.324986778s) [noise=true , address=77.90.31.15:4699     , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.521962652 (330h50m33.325427267s) [noise=true , address=145.79.227.15:4873   , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522055545 (330h50m33.325520137s) [noise=true , address=45.91.116.5:4298     , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522513190 (330h50m33.325977793s) [noise=true , address=45.91.116.11:4119    , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.522521037 (330h50m33.325985622s) [noise=true , address=145.79.227.3:4150    , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523075320 (330h50m33.326539922s) [noise=true , address=77.90.31.14:4661     , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523103510 (330h50m33.326568105s) [noise=true , address=45.91.116.4:4940     , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523596337 (330h50m33.327060939s) [noise=true , address=145.79.227.7:4293    , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.523621875 (330h50m33.327086466s) [noise=true , address=45.91.116.6:4974     , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.524158097 (330h50m33.327622698s) [noise=true , address=145.79.227.2:4113    , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:45.526079093 (330h50m33.329543684s) [noise=true , address=145.79.227.6:4257    , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Uploading piece...
Oct  7 08:20:46.140916541 (330h50m33.944381124s) [upload=291132]: Next returned nil segment
Oct  7 08:20:46.140946778 (330h50m33.944412002s) [upload=291132]: Waiting for error group managing segments...
Oct  7 08:20:46.271123745 (330h50m34.074588346s) [noise=true , address=45.91.116.5:4298     , piece_id=S3MRJB7XCVO2YEOPZKQOUTCJTBZM4DOQ4U5VC7UPVEVAZIXNHV3Q, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.271414274 (330h50m34.074878859s) [noise=true , address=45.91.116.11:4119    , piece_id=II4L4V7BDAUJQGMMV5XQ5KEJFNXGAPHLO3QXZ32P7GPN7IB6SEWA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.275456129 (330h50m34.078920722s) [noise=true , address=45.91.116.6:4974     , piece_id=QCMYCPCUDCXWBPRJTEUQSAYWTJK6X3BBSZ27QNWBFJWRQFCFVEXQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.284661716 (330h50m34.088126308s) [noise=true , address=77.90.31.14:4661     , piece_id=ULRU2KO74WZP7JIENBOXQRVQBXPVY2DWFAV4NBBTDF74WVRMMACA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.285613800 (330h50m34.089078386s) [noise=true , address=45.91.116.4:4940     , piece_id=RIR7OXRAXOIS2K44OTQUOVBA6EAWDAZL7JEWXIUN3XZ2JYXGFCOQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.287756095 (330h50m34.09122068s) [noise=true , address=77.90.31.18:4807     , piece_id=YHX7XDOCZNKF7GDPDSXG32USWXFOKOYOYYVPVLBTZDCKTFCLSNQQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.296824893 (330h50m34.100289487s) [noise=true , address=77.90.31.15:4699     , piece_id=IZLSA75T5QD67DTAZIC7XHQTXWQFBHO5AHW7SYRDZWIXSIITTM5A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.326180946 (330h50m34.12964553s) [noise=true , address=145.79.227.16:4910   , piece_id=VMOLODUZF2FEJNZ5QDS2QLBBD3FZIS7VIRZTBUW4BLCQ6TS5BHZQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.335625475 (330h50m34.139090079s) [noise=true , address=145.79.227.13:4801   , piece_id=2ZQOQ267CC5EYXLH43ZPGQWOYX4732QSYO6EA47HAVYVEXE2AD7A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.337689760 (330h50m34.14115435s) [noise=true , address=145.79.227.13:4803   , piece_id=U54JBHMWUS7LTSNH3XUDACSQ4C2YQ6TFKD3PASB6NJ7QZRHVRPZA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:20:46.343637412 (330h50m34.147101997s) [noise=true , address=145.79.227.2:4113    , piece_id=HCNPQ4IAAFXVNMLHHAEBIK5IRPIR265OITK3T6MWXDTSJZ5LSU3A, seg_pos={0 0}, upload=291132]: Done uploading piece. err: <nil>
Oct  7 08:21:15.127875357 (330h51m2.931339952s) [noise=true , address=145.79.227.7:4293    , piece_id=DR2HQDSCXHZGEDQVL7JCSWUWC5GVKEWAMU3GJB5OARJ6TT6CSQPA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38910->145.79.227.7:4293: use of closed network connection
Oct  7 08:21:15.127998971 (330h51m2.931463614s) [noise=true , address=145.79.227.5:4221    , piece_id=YG2FR6Y35M55ETMS2A2PAZEUIIAFZ4JPEBGVZERXLNXU3ZOHX5EA, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34486->145.79.227.5:4221: use of closed network connection
Oct  7 08:21:15.128085782 (330h51m2.931550366s) [noise=true , address=145.79.227.3:4150    , piece_id=2PKOHNSYOIYGDIO2CDAOS2X2GZYFMOATN6WPDKWYQMYVKVWWYIBQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40810->145.79.227.3:4150: use of closed network connection
Oct  7 08:21:15.128102416 (330h51m2.931567s) [noise=true , address=145.79.227.15:4873   , piece_id=GXRL2RHY3NB6SVPWJ25PSNRPATL33NZSZT6WLHCCQFHFADKSM4TQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46120->145.79.227.15:4873: use of closed network connection
Oct  7 08:21:15.128338776 (330h51m2.931803359s) [noise=true , address=145.79.227.6:4257    , piece_id=53MGRPAE2BVNADTXPYBTOPGPTZEH7FYSTNFZQGXJNK6VIBQQYEKQ, seg_pos={0 0}, upload=291132]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48268->145.79.227.6:4257: use of closed network connection
Oct  7 08:21:15.128378583 (330h51m2.931843169s) [seg_pos={0 0}, upload=291132]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Oct  7 08:21:15.229490268 (330h51m3.032954848s) [upload=291132]: Done uploading segments...
Oct  7 08:21:15.229520049 (330h51m3.032984641s) [upload=291132]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.492009471s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
1.301190873s
FAIL (2025-10-07 09:00:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.301217677s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
2.96572767s
FAIL (2025-10-07 09:00:22 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 2.965765618s core uplink us1