Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................................................X...........] duration: 1.509237573s trace: https://jaeger.dev.storj.io/trace/6f4db12b1eedbfa FAIL (2025-12-27 06:27:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.509268344s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................................................X..........] duration: 1.568944159s trace: https://jaeger.dev.storj.io/trace/6f4db12b1eedbfa FAIL (2025-12-27 06:26:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.568978004s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 3.228091057s trace: https://jaeger.dev.storj.io/trace/7d31b81de98d439f FAIL (2025-12-27 06:26:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.228115663s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................................................X.........] duration: 1.593777137s trace: https://jaeger.dev.storj.io/trace/6f4db12b1eedbfa FAIL (2025-12-27 06:25:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.59380516s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.979976249s trace: https://jaeger.dev.storj.io/trace/7d31b81de98d439f FAIL (2025-12-27 06:25:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.980028253s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................................................X........] duration: 1.581366554s trace: https://jaeger.dev.storj.io/trace/6f4db12b1eedbfa FAIL (2025-12-27 06:24:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.581396715s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 3.043780214s trace: https://jaeger.dev.storj.io/trace/7d31b81de98d439f FAIL (2025-12-27 06:24:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.0438101s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................................X.......] duration: 1.720730759s trace: https://jaeger.dev.storj.io/trace/6f4db12b1eedbfa FAIL (2025-12-27 06:24:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.720761052s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.722681593s trace: https://jaeger.dev.storj.io/trace/7d31b81de98d439f FAIL (2025-12-27 06:23:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.722714262s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.784581573s trace: https://jaeger.dev.storj.io/trace/7d31b81de98d439f FAIL (2025-12-27 06:23:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.784610948s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 3.334629348s trace: https://jaeger.dev.storj.io/trace/7d31b81de98d439f FAIL (2025-12-27 06:23:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.334825834s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................................X......] duration: 1.661749974s trace: https://jaeger.dev.storj.io/trace/6f4db12b1eedbfa FAIL (2025-12-27 06:23:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.661858548s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.832257691s trace: https://jaeger.dev.storj.io/trace/7d31b81de98d439f FAIL (2025-12-27 06:22:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.832287886s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................................X.....] duration: 1.549694412s trace: https://jaeger.dev.storj.io/trace/6f4db12b1eedbfa FAIL (2025-12-27 06:21:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.549721087s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.748367901s trace: https://jaeger.dev.storj.io/trace/7d31b81de98d439f FAIL (2025-12-27 06:21:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.748626295s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................................X....] duration: 2.056767253s trace: https://jaeger.dev.storj.io/trace/6f4db12b1eedbfa FAIL (2025-12-27 06:21:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.056798137s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.895470373s trace: https://jaeger.dev.storj.io/trace/7d31b81de98d439f FAIL (2025-12-27 06:21:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.895501302s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................................................X...] duration: 1.609690722s trace: https://jaeger.dev.storj.io/trace/6f4db12b1eedbfa FAIL (2025-12-27 06:21:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.609727788s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................................X..] duration: 1.591782483s trace: https://jaeger.dev.storj.io/trace/6f4db12b1eedbfa FAIL (2025-12-27 06:20:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.591808634s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.745044172s trace: https://jaeger.dev.storj.io/trace/7d31b81de98d439f FAIL (2025-12-27 06:20:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.745073336s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.609288088s trace: https://jaeger.dev.storj.io/trace/7d31b81de98d439f FAIL (2025-12-27 06:19:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.609309165s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.000909779s trace: https://jaeger.dev.storj.io/trace/7d31b81de98d439f FAIL (2025-12-27 06:19:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000934372s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................................X.] duration: 1.813242655s trace: https://jaeger.dev.storj.io/trace/6f4db12b1eedbfa FAIL (2025-12-27 06:19:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.813312456s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 5.000400375s trace: https://jaeger.dev.storj.io/trace/6f4db12b1eedbfa FAIL (2025-12-27 06:18:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000497997s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 902.594586ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 05:07:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 902.624339ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 925.324223ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 05:06:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 925.35212ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 866.11326ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 05:05:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 866.142824ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 893.654292ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 05:04:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 893.680733ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 916.792223ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 05:04:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 916.81947ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 933.229292ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 05:03:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 933.256769ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 833.620074ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 05:02:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 833.673302ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 835.002394ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 05:01:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 835.02917ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 884.280327ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 05:01:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 884.305992ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 899.144189ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 05:00:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 899.169185ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 899.229512ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 04:59:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 899.248505ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 872.160286ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 04:59:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 872.184916ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 499.360558ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 04:58:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 499.395239ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 416.188194ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 04:57:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 416.21387ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 429.313548ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 04:56:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 429.344056ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 535.393357ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 04:55:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 535.412975ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 874.425215ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 04:55:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 874.452453ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 974.839972ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 04:54:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 974.873412ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 913.201707ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 04:53:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 913.23481ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 471.142482ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 04:52:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 471.187531ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 469.08356ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 04:52:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 469.111377ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 855.944025ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 04:51:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 855.973101ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 442.045166ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 04:51:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 442.07179ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 860.177953ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 04:50:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 860.281699ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 918.678097ms trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 04:50:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 918.707602ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 1.01659968s trace: https://jaeger.dev.storj.io/trace/6182cca0903d3092 FAIL (2025-12-27 04:49:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 27 04:24:46.766101981 (516h56m26.746454616s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766414752 (516h56m26.746767395s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766782331 (516h56m26.747134973s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.766992983 (516h56m26.747345619s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767382896 (516h56m26.747735532s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.767784588 (516h56m26.748137233s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.771049012 (516h56m26.751401657s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.773154259 (516h56m26.753506904s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.775248507 (516h56m26.755601153s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.776158623 (516h56m26.756511265s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Uploading piece... Dec 27 04:24:46.867968142 (516h56m26.848320765s) [upload=454837]: Next returned nil segment Dec 27 04:24:46.867982380 (516h56m26.848335019s) [upload=454837]: Waiting for error group managing segments... Dec 27 04:24:46.894389505 (516h56m26.874742208s) [noise=true , address=89.149.201.147:4018 , piece_id=IHU67L3PM4FRQR67OG5HUN3IQBGHDDVNGSGJGQZIDDGMOALEQ3WQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.896896407 (516h56m26.877249044s) [noise=true , address=185.167.204.206:4045 , piece_id=D5KT63F7E4KKN5GLWLUJ4AAEDXOQBVSEYDXO4TOPEB3OGHAEU5JQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.898542194 (516h56m26.878894887s) [noise=true , address=185.167.204.206:4055 , piece_id=2E5MYC2V2734D77WLQYY656AWSR3LTTRHITBLEIV6YZJJLRRHG2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.902908742 (516h56m26.883261388s) [noise=true , address=185.167.204.206:4060 , piece_id=M3JTSVIT7NBZGK6YURZSM3KMM7N6NRW2UOVKDVSKZ4DXCM2OGFJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.903990106 (516h56m26.884342745s) [noise=true , address=185.167.204.206:4053 , piece_id=ZCV23ELCGT7T24GP7ACIW23QNQ3KDUY5YFQAIZJFM5ITMMM2YFUA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904254139 (516h56m26.884606783s) [noise=true , address=89.149.201.147:4004 , piece_id=ODHCANIMLSOQBKDTJFIEOPXTO2DREDN4LTFLH5KVPLTKVEPLBCWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.904685581 (516h56m26.88503822s) [noise=true , address=89.149.201.147:4019 , piece_id=SZCFHEKSIG67DK4U4WXHHMCHSS3DT3V3V5EPNIXYLGSJWTK5J5TQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905204384 (516h56m26.885557033s) [noise=true , address=89.149.201.147:4013 , piece_id=QQ62PDFWT57NU7QV4X5YVUXYK7YARBM2SPZMBEWUJ6GD5KKTLN7Q, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.905543011 (516h56m26.885895651s) [noise=true , address=81.171.14.70:4047 , piece_id=GVFB4UKF4HTY25C5FXKVX3WCCZVZ4LDPHHP44AGKAR5266HOQCZQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.914892364 (516h56m26.895245005s) [noise=true , address=89.149.201.147:4022 , piece_id=IOWCEOG5MLHNTEXI53JFIJ6UPQVLBZMCKOF2VAA4FXADOCDMJXSA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.916410143 (516h56m26.896762779s) [noise=true , address=185.167.204.205:4035 , piece_id=4H6DIH7GHLZJVHZMNOQ2G4ZMUYBSWKSYFZYOYCWBJ5OYOORIM7LQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.920403271 (516h56m26.900755911s) [noise=true , address=81.171.14.70:4027 , piece_id=M2ESU3U5HIYG42QJ74EE4PMZR7PGXTYVUQADRJMJNN5HXPA5IKKQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.926569721 (516h56m26.906922357s) [noise=true , address=185.167.204.205:4008 , piece_id=UFG2LVJUI3RKC3WDBWPCAU3GJLC6ZLTJH6C7P3Z6SJNDNLDWTS2A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.927771000 (516h56m26.908123644s) [noise=true , address=185.167.204.205:4030 , piece_id=SI6E2EVFYXEIH23VAD762XDSQTVDAMNAE3NQRHDSBIG3A264CMEQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934190370 (516h56m26.914543013s) [noise=true , address=81.171.14.70:4026 , piece_id=NFXGSOJL4IVFWSHA4AXJYYA2OCCUIAEDG5J6ENJJCEQTDRYHEERA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.934967947 (516h56m26.915320583s) [noise=true , address=81.171.14.70:4036 , piece_id=DRUDFA6C7GHKCMNJZ366UYLMD7R7NRIY7PUWIQPWUOWSN2W2PIYA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.939346728 (516h56m26.919699376s) [noise=true , address=81.171.14.70:4034 , piece_id=GE75E4TE43ZEDXV3HVAP4MDJR2QLMJJMFVMQSDX7YRZWRZCX3PJQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.945730413 (516h56m26.926083061s) [noise=true , address=185.167.204.206:4070 , piece_id=VANRPYZTIPDSZJGA2BBWU3EDGMH52AO5CDRQ33YFZJ3EXQDLPS5A, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:46.950190370 (516h56m26.930543011s) [noise=true , address=185.167.204.205:4012 , piece_id=J7MJQQZ5WSLODGNSOVWHR2NUFE4XDFUIHNKIFMOOQYVL5CYHJLRA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.328160382 (516h56m27.308513116s) [noise=true , address=89.149.201.147:4010 , piece_id=YSY6CWCYRVRLQQST6QFWU4SOHNDOEJAWXCSOVQFW7FCAYD6O4PAA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.362070917 (516h56m27.342423568s) [noise=true , address=89.149.201.147:4014 , piece_id=Q5DGKORGUX6XR6WILE2J6GZOPNOSHX2ENIOZUYLKOLAIPOHACLQQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.364901535 (516h56m27.345254182s) [noise=true , address=89.149.201.147:4006 , piece_id=UTEXDNGLVRVG27KFLTSTRY7FGWZFNDXDWCYE3QWJWAXACBNRCLBQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.375159323 (516h56m27.355511972s) [noise=true , address=81.171.14.70:4033 , piece_id=3MTU3AOKZQV7ZAFK6DM35JQDOLBRT2A2C5I46CDJBA5WX4D3EXFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.381200239 (516h56m27.361552862s) [noise=true , address=81.171.14.70:4035 , piece_id=XIG6C4ADFNWVHLBQNVTA3O54INPEKVHPI6WE2NRJT6MPBOACIJCQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.390936981 (516h56m27.371289617s) [noise=true , address=89.149.201.147:4001 , piece_id=VA7DXYMLTZ6X7J67LGEFLJA3X6PP3YABTQD7FI2YCXGB4SK2AZBA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392789746 (516h56m27.373142392s) [noise=true , address=89.149.201.147:4012 , piece_id=BQONU7WPPRO2OHM5BTBWNNXMMMX7HJJFCRT5JNTZQXGAWX2DIMMQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: <nil> Dec 27 04:24:47.392814848 (516h56m27.373167495s) [seg_pos={0 0}, upload=454837]: Segment reached optimal threshold of 26 pieces. Dec 27 04:24:47.393102543 (516h56m27.37345519s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393113015 (516h56m27.373465661s) [noise=true , address=81.171.14.70:4039 , piece_id=KM46YHU2BASOECYC5AK2KDFODDITV525BPOBNCVOGD5LZEXWHHWQ, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393151597 (516h56m27.373504241s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF Dec 27 04:24:47.393182500 (516h56m27.373535143s) [noise=true , address=89.149.201.147:4011 , piece_id=UEUUJ5UD53ABICWB4DNA6J5FFT2WSSQM2AWPA6I4QNO6XLHGQIFA, seg_pos={0 0}, upload=454837]: Long tail cancellation due to optimal threshold Dec 27 04:24:47.393204232 (516h56m27.373556863s) [seg_pos={0 0}, upload=454837]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 27 04:24:47.393292895 (516h56m27.373645532s) [upload=454837]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 27 04:24:47.393298316 (516h56m27.373650952s) [upload=454837]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 27 04:26:37.003947357 (516h58m16.984300009s) [upload=454837]: Done uploading segments... Dec 27 04:26:37.004348089 (516h58m16.984700736s) [upload=454837]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.016684717s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)