Orbiter History

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 782.633322ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Date=Thu, 17 Jul 2025 02:30:11 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-17 02:35:58 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway" Duration: 782.662314ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.022817353s remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Date=Thu, 17 Jul 2025 02:30:11 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-17 02:35:24 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway" Duration: 1.022901581s edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 617.24031ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Date=Thu, 17 Jul 2025 02:30:11 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-17 02:34:30 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway" Duration: 617.285693ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 650.252925ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Date=Thu, 17 Jul 2025 02:30:11 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-17 02:34:03 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway" Duration: 650.307345ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 583.60723ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Date=Thu, 17 Jul 2025 02:30:11 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-17 02:33:38 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway" Duration: 583.633726ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.119313544s remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Date=Thu, 17 Jul 2025 02:30:11 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-17 02:32:24 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway" Duration: 1.119362322s edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 724.079256ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Date=Thu, 17 Jul 2025 02:30:11 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-17 02:31:57 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway" Duration: 724.160741ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 615.682145ms remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Date=Thu, 17 Jul 2025 02:30:11 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-17 02:30:52 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway" Duration: 615.783937ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1.128039268s remote: "tcp:5.161.37.179:443" response headers: Access-Control-Allow-Origin=* Date=Thu, 17 Jul 2025 02:30:11 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-17 02:30:11 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway" Duration: 1.128069896s edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 3.942680796s FAIL (2025-07-16 22:40:33 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 3.942712135s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.889794077s FAIL (2025-07-16 22:39:47 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.889871509s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.781927084s FAIL (2025-07-16 22:39:29 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.781959335s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.961773408s FAIL (2025-07-16 22:39:13 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.961804625s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.773867478s FAIL (2025-07-16 22:38:02 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.773930433s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.557036478s FAIL (2025-07-16 22:37:41 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.557124834s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.57980972s FAIL (2025-07-16 22:37:25 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.579843228s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.809018951s FAIL (2025-07-16 22:36:29 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.809053542s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.853200016s FAIL (2025-07-16 22:35:50 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.853270745s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.803431145s FAIL (2025-07-16 22:35:25 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.803479201s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.87520198s FAIL (2025-07-16 22:34:46 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.875232506s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.741250765s FAIL (2025-07-16 22:33:35 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.741395706s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.705165891s FAIL (2025-07-16 22:33:00 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.705217245s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.876963442s FAIL (2025-07-16 22:32:25 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.87701699s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.717799585s FAIL (2025-07-16 22:32:06 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.717829143s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.450413909s FAIL (2025-07-16 22:30:57 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.450442365s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.605572541s FAIL (2025-07-16 22:30:37 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.605603225s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.55139206s FAIL (2025-07-16 22:29:31 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.551422812s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.490244673s FAIL (2025-07-16 22:28:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.490278274s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.57468239s FAIL (2025-07-16 22:28:19 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.574711993s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.840897669s FAIL (2025-07-16 22:27:23 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.840930489s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.765446425s FAIL (2025-07-16 22:26:11 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.765475539s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.867786056s FAIL (2025-07-16 22:25:16 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.867839046s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.696030386s FAIL (2025-07-16 22:24:19 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.696074749s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.507055092s FAIL (2025-07-16 22:23:27 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.507111023s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.747574542s FAIL (2025-07-16 22:22:48 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.747607472s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.706466962s FAIL (2025-07-16 22:22:07 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.706501581s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.499658358s FAIL (2025-07-16 22:21:01 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.499688749s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.667545508s FAIL (2025-07-16 22:19:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.667573719s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.640920585s FAIL (2025-07-16 22:18:56 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.640949679s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.751538843s FAIL (2025-07-16 22:17:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.75158452s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.947105128s FAIL (2025-07-16 22:16:54 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.947142954s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.994747102s FAIL (2025-07-16 22:16:35 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 2.99479315s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 3.017732978s FAIL (2025-07-16 22:15:35 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 3.017757059s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 3.565941025s FAIL (2025-07-16 22:14:34 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 3.565975542s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 3.134362827s FAIL (2025-07-16 22:13:46 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 3.134394667s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 3.402595739s FAIL (2025-07-16 22:12:44 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 3.402630853s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.542546011s FAIL (2025-07-16 22:12:22 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 5.542577443s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 3.01956468s FAIL (2025-07-16 22:11:49 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 3.019597229s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 3.096604034s FAIL (2025-07-16 22:11:32 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 3.096637885s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 4.036876957s FAIL (2025-07-16 22:11:11 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments... Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil> Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments... Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment... Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment. Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece... Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments... Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil> Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces. Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments... Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil> Duration: 4.03691531s core uplink us-select-1

Orbiter Check History

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)