Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 344920 reports (Page 6561 of 6899)
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
13.958006894s
FAIL (2025-07-21 23:15:53 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 13.958029424s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
4.309962419s
FAIL (2025-07-21 23:14:32 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.309978188s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
36.567054768s
FAIL (2025-07-21 23:14:13 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 36.567122934s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
13.024659208s
FAIL (2025-07-21 23:13:00 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 13.024687702s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
8.256581816s
FAIL (2025-07-21 23:11:49 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 8.256603493s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
23.865769586s
FAIL (2025-07-21 23:11:24 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 23.865915352s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
3.564494854s
FAIL (2025-07-21 23:09:57 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.564520961s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
32.877768692s
FAIL (2025-07-21 23:09:53 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 32.877841993s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
3.600627798s
FAIL (2025-07-21 23:08:15 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.600648029s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
39.678709962s
FAIL (2025-07-21 23:08:11 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 39.678750961s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
56.259609705s
FAIL (2025-07-21 23:07:16 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 56.259666566s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
15.239630891s
FAIL (2025-07-21 23:05:30 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 15.239645547s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
43.144416607s
FAIL (2025-07-21 23:05:15 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 43.144437909s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
33.136963269s
FAIL (2025-07-21 23:04:31 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 33.136977711s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
21.09589218s
FAIL (2025-07-21 23:03:58 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 21.095924338s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
10.649886262s
FAIL (2025-07-21 23:03:22 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 10.649960967s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
15.255012942s
FAIL (2025-07-21 23:02:24 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 15.255049997s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
20.194660927s
FAIL (2025-07-21 23:01:45 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 20.195567086s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
1m0.00135053s
FAIL (2025-07-21 23:01:13 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001374959s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
2.708037696s
FAIL (2025-07-20 06:01:26 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.708078207s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
3.094314834s
FAIL (2025-07-20 06:00:48 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 3.094339054s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
2.624283165s
FAIL (2025-07-20 06:00:24 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.624354146s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
4.234326927s
FAIL (2025-07-20 06:00:09 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 4.234400331s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
2.536325694s
FAIL (2025-07-20 05:59:06 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.536355016s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
2.470432426s
FAIL (2025-07-20 05:58:13 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.47048342s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
2.654263571s
FAIL (2025-07-20 05:57:27 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.654296525s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
3.12502155s
FAIL (2025-07-20 05:56:44 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 3.125058215s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
2.563801484s
FAIL (2025-07-20 05:55:30 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.563839387s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
2.549712753s
FAIL (2025-07-20 05:55:08 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.549754562s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
2.896663863s
FAIL (2025-07-20 05:54:44 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.896724051s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................]
duration:
2.89274155s
FAIL (2025-07-20 05:54:00 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.892770493s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
2.616730056s
FAIL (2025-07-20 05:53:04 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.616766706s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration:
2.560741926s
FAIL (2025-07-20 05:52:33 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.560774807s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration:
2.499940927s
FAIL (2025-07-20 05:51:31 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.499972693s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................]
duration:
2.550794035s
FAIL (2025-07-20 05:50:51 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.550829305s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
2.646858778s
FAIL (2025-07-20 05:49:55 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.646889083s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
2.565255506s
FAIL (2025-07-20 05:48:46 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.565300608s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
2.893449698s
FAIL (2025-07-20 05:48:31 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.893483457s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
2.499284765s
FAIL (2025-07-20 05:48:14 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.499314104s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
2.588020386s
FAIL (2025-07-20 05:47:16 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.588044283s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
2.535074847s
FAIL (2025-07-20 05:46:24 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.535115762s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
2.488855146s
FAIL (2025-07-20 05:45:42 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.488888907s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
2.409667285s
FAIL (2025-07-20 05:45:11 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.409742237s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................]
duration:
2.651218528s
FAIL (2025-07-20 05:44:25 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.651248135s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
2.479003701s
FAIL (2025-07-20 05:43:55 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.479032826s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
2.507929654s
FAIL (2025-07-20 05:42:55 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.507970212s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
2.786068022s
FAIL (2025-07-20 05:42:18 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.786102668s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
2.532332116s
FAIL (2025-07-20 05:41:26 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
5:32.878527010 (30h24m59.795632005s) [upload=24421]: Uploading segments...
Jul 20 05:15:32.878850543 (30h24m59.795955535s) [upload=24421]: Got next segment. Inline: false
Jul 20 05:15:32.878929665 (30h24m59.796034715s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 20 05:15:32.878937641 (30h24m59.796042656s) [upload=24421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 20 05:15:33.140549621 (30h25m0.057654635s) [seg_pos={0 0}, upload=24421]: Begin upload segment...
Jul 20 05:15:33.140702141 (30h25m0.057807158s) [seg_pos={0 0}, upload=24421]: Done begin upload segment.
Jul 20 05:15:33.140772488 (30h25m0.057877495s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.140786771 (30h25m0.057891784s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141143230 (30h25m0.058248235s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141312852 (30h25m0.058417866s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141510922 (30h25m0.058615935s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141795025 (30h25m0.058900039s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.141841492 (30h25m0.058946496s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142156571 (30h25m0.059261563s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142286939 (30h25m0.059391952s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142486908 (30h25m0.059591914s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142810280 (30h25m0.059915287s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.142860885 (30h25m0.059965901s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143137020 (30h25m0.060242023s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143407049 (30h25m0.060512062s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143472689 (30h25m0.060577692s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143827070 (30h25m0.060932061s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.143957610 (30h25m0.061062624s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.144096344 (30h25m0.061201333s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Uploading piece...
Jul 20 05:15:33.705873819 (30h25m0.622978813s) [upload=24421]: Next returned nil segment
Jul 20 05:15:33.705892564 (30h25m0.622997569s) [upload=24421]: Waiting for error group managing segments...
Jul 20 05:15:33.844441645 (30h25m0.761546668s) [noise=true , address=77.90.31.16:4761     , piece_id=RVG4QEF52PL7BLEFZGZ3N6IDW2S7DX3H2J74ARUFCWOGOQ3B5PTA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.846027460 (30h25m0.763132462s) [noise=true , address=45.91.116.10:4100    , piece_id=FJS3E6T3SD5K4IN55HU3VOCR3YIZJN4QCITYT7NXJRVQH2NCYS3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.851362730 (30h25m0.76846774s) [noise=true , address=45.91.116.8:4078     , piece_id=MFYPUDAL2P3KFRS4XLBSMNSXXPXKIQQ453GYHGVZTICI7YXV6R7Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.855474477 (30h25m0.772579487s) [noise=true , address=45.91.116.12:4257    , piece_id=N4CGLUHCPECINV6AHQ3UPWPTJYYNN2PN77IRRVEKVQR5B6DDRONA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.874892339 (30h25m0.791997353s) [noise=true , address=45.91.116.9:4281     , piece_id=EUVFLXMKRYRS5RODXLUA3MPBJOB7RUZCKMS44G67SRA6SEKSK7ZA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.880583940 (30h25m0.797688953s) [noise=true , address=104.36.82.50:4017    , piece_id=WLJRN3NG7YCOQUDEGREIZTA5G2Q3BYSIZZCA4C5DLYCHL6INBZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.904745207 (30h25m0.8218502s) [noise=true , address=104.36.82.7:4925     , piece_id=TJTTIDBG43FMFBLT3QMT7PB2FXUWEQP3OJKUQOVOYBRX7G4IPGLQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.905133548 (30h25m0.822238588s) [noise=true , address=79.127.219.51:4207   , piece_id=7Q7SNTELD3WB34BU422WN7DMQF6JPAJCU4OJE6TXNFLPKPXJK3IQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:33.910583397 (30h25m0.827688388s) [noise=true , address=104.36.82.52:4105    , piece_id=EIG4RHOYUSPTAKYRIVAALBN5GOI5OSSHFMM7E3RQYK3H5NARHQHQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.015151592 (30h25m0.93225659s) [noise=true , address=45.91.95.5:4002      , piece_id=5PPVVZM7SLTCXUZ3PAHT7SVKHJ3QFJOAFUUBZVDIK43LSBEKIZDA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.075395924 (30h25m0.992500917s) [noise=true , address=45.91.95.3:4014      , piece_id=2AGBDGD3SMGIY5B4EKVREQHHE6GUARWFNKRMH5JXKKMQHA57QXPA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.091411178 (30h25m1.008516245s) [noise=true , address=45.91.95.3:4003      , piece_id=DLMWXXVVK5KYIRSG4LGOHQCQNCWQDQMH5WQXQOYTCF5H2KJFNV3Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:15:34.452449133 (30h25m1.369554127s) [noise=true , address=64.49.13.170:4719    , piece_id=H2ISKNXMSD2N7KGLUYU62NVUGPIAZLYW5U3YP2A7WAZVODTC2KFQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: <nil>
Jul 20 05:16:32.608089355 (30h25m59.525194352s) [noise=true , address=79.127.205.235:4689  , piece_id=4PXXA5GHHQEXY45E5KGVY3ZS7V7W3VA2PMLGGFWQHCC3YHN46IYA, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TFdxckSXAWn5yxsjR8XD97Rj6bmbteeEjrQXx7ko16AXnXE91, address:79.127.205.235:4689): protocol: read tcp 139.59.144.22:38084->79.127.205.235:4689: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608116359 (30h25m59.525221356s) [noise=true , address=79.127.205.233:4650  , piece_id=KXB2LFWTSYIGZ337WLAETMMXZC6AN3HYXQIVCCFWEUO5HBUPPIWQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12hA5tXuKjGsjJCU9XLeNBXkkahm3FXqLWM83Fk3Hu1TH6rMgoh, address:79.127.205.233:4650): protocol: rpc: dial tcp 79.127.205.233:4650: i/o timeout; context deadline exceeded
Jul 20 05:16:32.608156524 (30h25m59.525261529s) [noise=true , address=79.127.205.245:4238  , piece_id=GMZ5CSSOVZHHDR5UAD6CAMAX7ZVTKIMHLXX3FFGBNRUVA26HJPTQ, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12HbtNBf7iq1rVxPqjnzPko4oVhpkHft7tEoqc7gSXKa7xEtMFU, address:79.127.205.245:4238): protocol: read tcp 139.59.144.22:49056->79.127.205.245:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608259757 (30h25m59.525364752s) [noise=true , address=79.127.205.234:4618  , piece_id=7LJDCRYMJ4KFEKOPVTVX6AVPWPC2LGCGCW2W2ZETU6EXK5KKGS6Q, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12fENzYmY86ZTGsXqf9rXgmZxpSWy1wUbqdS2AZYwa7AbiBYLXy, address:79.127.205.234:4618): protocol: rpc: dial tcp 79.127.205.234:4618: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608290629 (30h25m59.525395623s) [noise=true , address=79.127.205.246:4272  , piece_id=MYLOECL7FGCFLHDCPTNZYN6HMVHMRZFNICJ47M3DESK5FXRV7A7A, seg_pos={0 0}, upload=24421]: Done uploading piece. err: ecclient: upload failed (node:12TLFJ7HD7rVyLCyaKdy7DAJ1XvdN6s6gg6FuKQ58oJsRV6fhU6, address:79.127.205.246:4272): protocol: read tcp 139.59.144.22:58578->79.127.205.246:4272: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 20 05:16:32.608339482 (30h25m59.525444489s) [seg_pos={0 0}, upload=24421]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 20 05:16:32.713758281 (30h25m59.630863272s) [upload=24421]: Done uploading segments...
Jul 20 05:16:32.713798131 (30h25m59.63090312s) [upload=24421]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 2.532366703s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
909.871967ms
FAIL (2025-07-20 05:41:08 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 909.907271ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
1.106114729s
FAIL (2025-07-20 05:40:53 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.106202699s core uplink us1