Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.57980972s
FAIL (2025-07-16 22:37:25 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.579843228s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.809018951s
FAIL (2025-07-16 22:36:29 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.809053542s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.853200016s
FAIL (2025-07-16 22:35:50 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.853270745s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.803431145s
FAIL (2025-07-16 22:35:25 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.803479201s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.87520198s
FAIL (2025-07-16 22:34:46 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.875232506s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.741250765s
FAIL (2025-07-16 22:33:35 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.741395706s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.705165891s
FAIL (2025-07-16 22:33:00 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.705217245s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.876963442s
FAIL (2025-07-16 22:32:25 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.87701699s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.717799585s
FAIL (2025-07-16 22:32:06 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.717829143s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.450413909s
FAIL (2025-07-16 22:30:57 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.450442365s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.605572541s
FAIL (2025-07-16 22:30:37 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.605603225s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.55139206s
FAIL (2025-07-16 22:29:31 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.551422812s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.490244673s
FAIL (2025-07-16 22:28:52 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.490278274s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.57468239s
FAIL (2025-07-16 22:28:19 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.574711993s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.840897669s
FAIL (2025-07-16 22:27:23 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.840930489s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.765446425s
FAIL (2025-07-16 22:26:11 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.765475539s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.867786056s
FAIL (2025-07-16 22:25:16 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.867839046s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.696030386s
FAIL (2025-07-16 22:24:19 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.696074749s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.507055092s
FAIL (2025-07-16 22:23:27 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.507111023s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.747574542s
FAIL (2025-07-16 22:22:48 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.747607472s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.706466962s
FAIL (2025-07-16 22:22:07 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.706501581s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.499658358s
FAIL (2025-07-16 22:21:01 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.499688749s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.667545508s
FAIL (2025-07-16 22:19:52 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.667573719s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.640920585s
FAIL (2025-07-16 22:18:56 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.640949679s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.751538843s
FAIL (2025-07-16 22:17:52 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.75158452s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.947105128s
FAIL (2025-07-16 22:16:54 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.947142954s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.994747102s
FAIL (2025-07-16 22:16:35 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.99479315s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
3.017732978s
FAIL (2025-07-16 22:15:35 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 3.017757059s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
3.565941025s
FAIL (2025-07-16 22:14:34 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 3.565975542s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
3.134362827s
FAIL (2025-07-16 22:13:46 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 3.134394667s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
3.402595739s
FAIL (2025-07-16 22:12:44 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 3.402630853s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.542546011s
FAIL (2025-07-16 22:12:22 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 5.542577443s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
3.01956468s
FAIL (2025-07-16 22:11:49 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 3.019597229s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
3.096604034s
FAIL (2025-07-16 22:11:32 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 3.096637885s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
4.036876957s
FAIL (2025-07-16 22:11:11 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 4.03691531s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
4.636724197s
FAIL (2025-07-16 22:10:15 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 4.636759728s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
3.314648844s
FAIL (2025-07-16 22:09:37 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 3.314751175s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
7.913403724s
FAIL (2025-07-16 22:08:29 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 7.913430893s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.908432797s
FAIL (2025-07-16 22:07:17 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.908479098s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.957146625s
FAIL (2025-07-16 22:06:29 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.95717847s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.940107942s
FAIL (2025-07-16 22:05:30 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.940138941s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.894767411s
FAIL (2025-07-16 22:04:16 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.894801165s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.83802285s
FAIL (2025-07-16 22:03:02 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.83805831s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.70197184s
FAIL (2025-07-16 22:01:58 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.701995789s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.782829534s
FAIL (2025-07-16 22:00:51 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.782897158s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
3.137781756s
FAIL (2025-07-16 21:59:40 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 3.137812013s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.712146373s
FAIL (2025-07-16 21:58:59 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.712175135s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
3.28268025s
FAIL (2025-07-16 21:58:30 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 3.282711754s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.984364378s
FAIL (2025-07-16 21:57:25 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 2.98440346s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
3.239095987s
FAIL (2025-07-16 21:56:58 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
52:22.359434120 (564h41m22.242847747s) [noise=true , address=104.36.82.16:4294 , piece_id=C3U5LQY2F76K6LECQQOEUFQRCT433QUW2UJHM7TLUAURGJEK3VBQ, seg_pos={0 0}, upload=451600]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e): protocol: expected piece hash; context canceled; EOF
Jul 16 21:52:22.359455005 (564h41m22.242883095s) [seg_pos={0 0}, upload=451600]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:52:22.359585973 (564h41m22.242999585s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:52:22.359592396 (564h41m22.243006021s) [upload=451600]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:52:22.505839688 (564h41m22.389253301s) [upload=451600]: Done uploading segments...
Jul 16 21:52:22.505880026 (564h41m22.389293654s) [upload=451600]: Upload finished. err: <nil>
Jul 16 21:53:20.044244602 (564h42m19.927658236s) [upload=451612]: Starting upload
Jul 16 21:53:20.044352238 (564h42m19.927765888s) [upload=451612]: Done starting upload
Jul 16 21:53:20.044507436 (564h42m19.927921054s) [upload=451612]: Uploading segments...
Jul 16 21:53:20.045073709 (564h42m19.928487351s) [upload=451612]: Got next segment. Inline: false
Jul 16 21:53:20.045126036 (564h42m19.928539658s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 16 21:53:20.045143192 (564h42m19.928556831s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 16 21:53:20.159448623 (564h42m20.042862256s) [seg_pos={0 0}, upload=451612]: Begin upload segment...
Jul 16 21:53:20.159510624 (564h42m20.042924261s) [seg_pos={0 0}, upload=451612]: Done begin upload segment.
Jul 16 21:53:20.159540083 (564h42m20.042953718s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159551683 (564h42m20.042965313s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159612102 (564h42m20.043025716s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.159896511 (564h42m20.043310137s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160018235 (564h42m20.043431877s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160150352 (564h42m20.043563982s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160427915 (564h42m20.043841553s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160522286 (564h42m20.043935915s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160889514 (564h42m20.044303132s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.160901365 (564h42m20.044315002s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161190809 (564h42m20.044604435s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161295631 (564h42m20.044709267s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161513041 (564h42m20.044926673s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.161686359 (564h42m20.045099995s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162153353 (564h42m20.045566989s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.162541105 (564h42m20.04595474s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Uploading piece...
Jul 16 21:53:20.771118381 (564h42m20.654532001s) [upload=451612]: Next returned nil segment
Jul 16 21:53:20.771162346 (564h42m20.654575976s) [upload=451612]: Waiting for error group managing segments...
Jul 16 21:53:20.897613914 (564h42m20.781027546s) [noise=true , address=77.90.31.15:4699 , piece_id=TS6ZDA7FADK3R5PZBKHBH3W2TRG43ZQM3HVZYV6T3FUQR5VPCA4A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.904275354 (564h42m20.787688971s) [noise=true , address=45.91.116.14:4189 , piece_id=SIWKJHGG5JELIWMKPNYH3GN6YIAX4XZV6OEYHHRAXQ2WCECKXTYA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.907336025 (564h42m20.790749656s) [noise=true , address=77.90.31.14:4661 , piece_id=PTOT7XLU7E6L4OMXUZK5DVD7B2AEWHVXOF3M7O4GQRM3CLELXKPQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.913938324 (564h42m20.797351945s) [noise=true , address=45.91.116.6:4974 , piece_id=PTEAYAD7H22FQDZXIFSZBCATD3SFFWSGQ4ANC7JUVEUSLFILAOLQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.917599148 (564h42m20.801012767s) [noise=true , address=45.91.116.14:4191 , piece_id=6UDI4DN4UYIQQSPJTOIYOOQMG3YKG3FAXZPH2PMRRAIJUJZ5XMSQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.920734366 (564h42m20.804147994s) [noise=true , address=77.90.31.16:4734 , piece_id=QX74WPTKJJCFOMGVREFHETPRU4FK45LJVTPGVDUZGWMEFRST4ITQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.921605782 (564h42m20.805019395s) [noise=true , address=45.91.116.4:4939 , piece_id=KWMW5XC6C7SZ4JX2HZNWSW2EPUXTTAJ57GNAP4QCCLXYLXA3N55A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.941196536 (564h42m20.824610149s) [noise=true , address=45.91.116.10:4081 , piece_id=5GPIMRDLWNYVHC5OKBC636XVJQUQJSRRAZXWJSSE7BLKBAWPCGSA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.945986968 (564h42m20.829400582s) [noise=true , address=104.36.82.15:4257 , piece_id=FOYX2ZHMUJGZOKX4IZT3ZGBGTNP4SSDUOQCE7UJWN2AAZCDROKMA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.949633768 (564h42m20.833047387s) [noise=true , address=45.91.116.7:4011 , piece_id=7KZ3VH4ETVMYW6GXHZGM4HXPM44GULDRLSTRAJ4HLEASYJAFACVQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952226240 (564h42m20.835639866s) [noise=true , address=104.36.82.10:4078 , piece_id=RDEFMBNCP3YETEG7WWJ5KPJEIPTMOGFWCW7PTQGHLBXM7LUHLT7A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.952984579 (564h42m20.8363982s) [noise=true , address=104.36.82.5:4840 , piece_id=EF56UW3HUJTCLYTUCUO2TRQBCBBM2Q724CV4KXOFYGKKARGCD7RQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955150147 (564h42m20.83856376s) [noise=true , address=77.90.31.11:4554 , piece_id=W36RVYBJLHHTUSRIHZMIDFCMX462ZTNV36QFUZSMUNVCT7VDE4SQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: <nil>
Jul 16 21:53:20.955194150 (564h42m20.838607777s) [seg_pos={0 0}, upload=451612]: Segment reached optimal threshold of 13 pieces.
Jul 16 21:53:20.955385711 (564h42m20.83879934s) [noise=true , address=104.36.82.4:4801 , piece_id=4CIWTELM2SI22BOLTZV25FBLTM5YNPSPXTPVIZCSLZTTWA4YZ6FA, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955447698 (564h42m20.838861319s) [noise=true , address=104.36.82.6:4876 , piece_id=VWZHQHDCDMFRMZ63B7VY5B6C7XGN7B4A6HZW6SUI5E2RXURVAO6A, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955508573 (564h42m20.8389222s) [noise=true , address=104.36.82.16:4295 , piece_id=3ECPTFG3D75TBEMJX7TKNS3OP33JM73U45Y4S7L4OFKWPVE5IEBQ, seg_pos={0 0}, upload=451612]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF
Jul 16 21:53:20.955532224 (564h42m20.83894584s) [seg_pos={0 0}, upload=451612]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 16 21:53:20.955604799 (564h42m20.839018425s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 16 21:53:20.955609475 (564h42m20.839023101s) [upload=451612]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 16 21:53:21.130661274 (564h42m21.014074906s) [upload=451612]: Done uploading segments...
Jul 16 21:53:21.130692223 (564h42m21.014105848s) [upload=451612]: Upload finished. err: <nil>
Duration: 3.239129147s
core
uplink
us-select-1
|