Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [..............................................XXXXXXXXX.....] duration: 2.812202807s FAIL (2025-09-22 16:09:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.812243166s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [...............................................XXXXXXXXX....] duration: 2.796059439s FAIL (2025-09-22 16:08:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.796181967s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [................................................XXXXXXXXX...] duration: 2.837042032s FAIL (2025-09-22 16:07:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.837068582s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [.................................................XXXXXXXXX..] duration: 2.719928451s FAIL (2025-09-22 16:06:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.719970124s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [..................................................XXXXXXXXX.] duration: 2.905850039s FAIL (2025-09-22 16:05:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.905870563s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [...................................................XXXXXXXXX] duration: 30.001609728s FAIL (2025-09-22 16:05:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001629878s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [....................................................XXXXXXXX] duration: 30.000784311s FAIL (2025-09-22 16:04:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000810045s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [.....................................................XXXXXXX] duration: 30.006108495s FAIL (2025-09-22 16:04:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.006156036s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [......................................................XXXXXX] duration: 30.000980958s FAIL (2025-09-22 16:03:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001085635s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration: 30.000617482s FAIL (2025-09-22 16:02:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000632642s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................................................XXXX] duration: 30.001119497s FAIL (2025-09-22 16:01:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001144847s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 30.001747427s FAIL (2025-09-22 16:00:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001777377s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 30.00105641s FAIL (2025-09-22 16:00:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001089377s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000697859s FAIL (2025-09-22 15:59:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.00072497s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.505772876s FAIL (2025-09-22 15:48:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.505802522s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.572189582s FAIL (2025-09-22 15:46:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.572223245s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.845553809s FAIL (2025-09-22 15:46:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.845592906s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.456025476s FAIL (2025-09-22 15:45:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.456054526s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.653945443s FAIL (2025-09-22 15:44:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.653979083s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.549179687s FAIL (2025-09-22 15:44:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.549216127s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.51481757s FAIL (2025-09-22 15:43:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.514850987s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.640635751s FAIL (2025-09-22 15:42:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.640667607s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.622829513s FAIL (2025-09-22 15:41:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.622857577s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.549056218s FAIL (2025-09-22 15:41:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.549076372s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.746596323s FAIL (2025-09-22 15:41:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.746630091s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.669751774s FAIL (2025-09-22 15:40:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.669893698s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.491115981s FAIL (2025-09-22 15:39:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.491143601s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.686015683s FAIL (2025-09-22 15:38:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.686050942s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.609256929s FAIL (2025-09-22 15:37:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.609287667s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 3.648232267s FAIL (2025-09-22 15:36:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 3.648267753s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.555194201s FAIL (2025-09-22 15:36:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 5.555225077s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 4.311021232s FAIL (2025-09-22 15:35:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 4.311051539s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.501838402s FAIL (2025-09-22 15:34:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.501891286s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 3.089864935s FAIL (2025-09-22 15:34:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 3.089918566s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 3.685310261s FAIL (2025-09-22 15:33:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 3.685342609s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 3.276816343s FAIL (2025-09-22 15:32:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 3.276916436s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.796339597s FAIL (2025-09-22 15:32:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.796441122s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.51322656s FAIL (2025-09-22 15:31:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.5132555s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.534540415s FAIL (2025-09-22 15:31:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.53456913s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.703054279s FAIL (2025-09-22 15:30:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.703156022s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.777200288s FAIL (2025-09-22 15:30:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.777233511s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.53882347s FAIL (2025-09-22 15:29:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.538858298s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.645652443s FAIL (2025-09-22 15:28:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.64568341s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.612144253s FAIL (2025-09-22 15:27:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.612175528s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.420019275s FAIL (2025-09-22 15:26:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.420054777s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.148314585s FAIL (2025-09-22 15:26:25 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.148352075s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.567389225s FAIL (2025-09-22 15:26:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.567424557s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.577480794s FAIL (2025-09-22 15:25:27 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.577513188s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.542690837s FAIL (2025-09-22 15:25:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 22 15:04:22.278811478 (576h56m42.771243912s) [upload=507522]: Starting upload Sep 22 15:04:22.278911969 (576h56m42.771344415s) [upload=507522]: Done starting upload Sep 22 15:04:22.279032908 (576h56m42.771465342s) [upload=507522]: Uploading segments... Sep 22 15:04:22.279358641 (576h56m42.771791074s) [upload=507522]: Got next segment. Inline: false Sep 22 15:04:22.279413909 (576h56m42.771846342s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 15:04:22.279419330 (576h56m42.771851774s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 15:04:22.410488552 (576h56m42.902921001s) [seg_pos={0 0}, upload=507522]: Begin upload segment... Sep 22 15:04:22.410568996 (576h56m42.903001427s) [seg_pos={0 0}, upload=507522]: Done begin upload segment. Sep 22 15:04:22.410600540 (576h56m42.903032993s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411125265 (576h56m42.903557712s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411405340 (576h56m42.903837785s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.411696353 (576h56m42.904128795s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412165827 (576h56m42.904598278s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412476281 (576h56m42.904908726s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.412756291 (576h56m42.905188736s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413124339 (576h56m42.905556784s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413463434 (576h56m42.905895879s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.413980639 (576h56m42.906413087s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414291528 (576h56m42.90672397s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414533448 (576h56m42.90696589s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.414761823 (576h56m42.907194265s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415059857 (576h56m42.907492298s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415394440 (576h56m42.907826888s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:22.415644454 (576h56m42.908076897s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Uploading piece... Sep 22 15:04:23.026685865 (576h56m43.519118308s) [upload=507522]: Next returned nil segment Sep 22 15:04:23.026778864 (576h56m43.519211306s) [upload=507522]: Waiting for error group managing segments... Sep 22 15:04:23.165578203 (576h56m43.65801064s) [noise=true , address=45.91.116.13:4154 , piece_id=TCKKEQ7SOHUVRNV4WMOWQ27QGBZEFP7OVGFZPVRYOW6EW6PWJAQA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.166343517 (576h56m43.658775952s) [noise=true , address=77.90.31.16:4733 , piece_id=QYRENKLNZOVJSQZP4D2OORMOK6FSZMED2F5YUM75WUU5PAV564VQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.168966099 (576h56m43.661398532s) [noise=true , address=45.91.116.13:4155 , piece_id=O6EV6AIB7JVEZ37QZMOZS5DVYH6MNS3L7EFBSJ6GXH3G3SS34IVQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.170851645 (576h56m43.663284089s) [noise=true , address=45.91.116.11:4118 , piece_id=4YS2N7KRI4NBP455PQFZV3ERZ4JG4DBFACWVLKIXILFRHZFVNXSQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171026163 (576h56m43.663458597s) [noise=true , address=45.91.116.9:4261 , piece_id=D42IFDSQTGWG2KFXSHU6LUM2TSIGCSVMQEK65ARRHZUVJD4CNPCA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.171341245 (576h56m43.663773681s) [noise=true , address=45.91.116.14:4190 , piece_id=L5IZ7TPY7N52G7FM54JD44OB7DMNCBKY4JYBG27OUWGZOHN2LDAA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172004301 (576h56m43.664436729s) [noise=true , address=45.91.116.12:4226 , piece_id=NNYSV7RQPJEPPTMD4R3U5EXQEZETKRHEI3X7U3IOGPV6WUYNPYFQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.172134055 (576h56m43.664566488s) [noise=true , address=45.91.116.5:4298 , piece_id=62LMEOHQ55ZZ2PDRPGMWOADSHMQHHVPNWVHC7DFP5KOMHWHPEVBA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.176964234 (576h56m43.669396671s) [noise=true , address=77.90.31.17:4771 , piece_id=LW3GO2NOKOCUUCF3UE5U4RLERTGZFOZHHLQ32JDHCZLMFX235YRQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.178650848 (576h56m43.671083281s) [noise=true , address=77.90.31.12:4592 , piece_id=7RMMGQINPHFJKK2THULVH3ZZS4HDDTJ3HEB5QWASEV4MHLT6LEJA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.179150103 (576h56m43.671582538s) [noise=true , address=45.91.116.4:4940 , piece_id=ELQMLDOTAVRYLM7EJPYT5RBQEHSOGPEWT2S7RSSCICGKQT6I4TJQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.180276368 (576h56m43.672708796s) [noise=true , address=45.91.116.14:4191 , piece_id=ET46XJKSGAV6GJYA3HYMTJR2SMYDTEVFEQXPX4KIG73E2UBLUEYQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186246086 (576h56m43.678678521s) [noise=true , address=77.90.31.11:4553 , piece_id=MRAN43Q4XHAFAXULNTN5FC23ZL3UK4KEB77JGGGUBDNLZWJUCGKQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: <nil> Sep 22 15:04:23.186271015 (576h56m43.678703457s) [seg_pos={0 0}, upload=507522]: Segment reached optimal threshold of 13 pieces. Sep 22 15:04:23.186430552 (576h56m43.678862988s) [noise=true , address=77.90.31.13:4628 , piece_id=7W5NCVFAIEZ3SPTYFS4DTGJKRC2YX3NM4VZVSDLSR753ECXUYFBQ, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186452297 (576h56m43.678884741s) [noise=true , address=77.90.31.16:4735 , piece_id=YWHCMSBNTLKMM5LZ4OT3X4KAJJ6ELLCHKQYSSJ2NWKMPCZR32LRA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186515049 (576h56m43.678947492s) [noise=true , address=45.91.116.6:4974 , piece_id=XRNBQZAMXRH7ZTFRXW7Y4BYIR234CIAVLVZXWUOAMKD4RG44TXYA, seg_pos={0 0}, upload=507522]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Sep 22 15:04:23.186545155 (576h56m43.678977598s) [seg_pos={0 0}, upload=507522]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 22 15:04:23.186665165 (576h56m43.679097607s) [upload=507522]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 22 15:04:23.186670545 (576h56m43.679102987s) [upload=507522]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 22 15:04:23.400114729 (576h56m43.892547165s) [upload=507522]: Done uploading segments... Sep 22 15:04:23.400146421 (576h56m43.892578857s) [upload=507522]: Upload finished. err: <nil> Duration: 2.542722132s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.710668429s FAIL (2025-09-22 15:25:00 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.710735758s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)