Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 3.101821088s FAIL (2025-07-26 21:25:24 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 3.101852643s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.449708806s FAIL (2025-07-26 21:24:22 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.449746876s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 3.424413722s FAIL (2025-07-26 21:24:04 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 3.424517152s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.473683471s FAIL (2025-07-26 21:23:34 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.473714227s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.923668247s FAIL (2025-07-26 21:22:59 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.923711005s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.906307397s FAIL (2025-07-26 21:21:44 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.906339651s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.233076698s FAIL (2025-07-26 21:20:36 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.233112556s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 3.017947338s FAIL (2025-07-26 21:19:58 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 3.017989155s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 3.330369679s FAIL (2025-07-26 21:19:11 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 3.330467558s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 3.220866255s FAIL (2025-07-26 21:18:31 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 3.220904544s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.622363122s FAIL (2025-07-26 21:17:18 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.622403688s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 3.294609674s FAIL (2025-07-26 21:16:54 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 3.294638202s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.644572813s FAIL (2025-07-26 21:15:51 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.644606255s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.436520547s FAIL (2025-07-26 21:15:00 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.436554657s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.018330271s FAIL (2025-07-26 21:14:27 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 5.01836358s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.642368697s FAIL (2025-07-26 21:14:04 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.642472145s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.331884278s FAIL (2025-07-26 21:13:31 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.331924473s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.524369979s FAIL (2025-07-26 21:13:22 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== rue , address=45.91.116.6:4975 , piece_id=VG5RNI2Z6A6FGM7I6WHCNJJIMZUNXKEXYNT367PJEN756GSYLXCQ, seg_pos={0 0}, upload=54545]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:05.089846946 (56h52m36.280145528s) [seg_pos={0 0}, upload=54545]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 26 20:28:05.204635709 (56h52m36.394934281s) [upload=54545]: Done uploading segments... Jul 26 20:28:05.204661999 (56h52m36.394960579s) [upload=54545]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Jul 26 20:28:26.499846533 (56h52m57.690145103s) [upload=54558]: Starting upload Jul 26 20:28:26.499918833 (56h52m57.690217403s) [upload=54558]: Done starting upload Jul 26 20:28:26.499982310 (56h52m57.690280894s) [upload=54558]: Uploading segments... Jul 26 20:28:26.500267631 (56h52m57.690566217s) [upload=54558]: Got next segment. Inline: false Jul 26 20:28:26.500323092 (56h52m57.690621681s) [upload=54558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 20:28:26.500349824 (56h52m57.690648517s) [upload=54558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 20:28:26.611161117 (56h52m57.801459686s) [seg_pos={0 0}, upload=54558]: Begin upload segment... Jul 26 20:28:26.611211593 (56h52m57.801510173s) [seg_pos={0 0}, upload=54558]: Done begin upload segment. Jul 26 20:28:26.611242346 (56h52m57.801540931s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.611787891 (56h52m57.802086479s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612150870 (56h52m57.802449454s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612502942 (56h52m57.802801528s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612827744 (56h52m57.80312633s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613395709 (56h52m57.803694297s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613836447 (56h52m57.804135041s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614376380 (56h52m57.804674968s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614682063 (56h52m57.804980645s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614954123 (56h52m57.805252705s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615254738 (56h52m57.805553321s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615524618 (56h52m57.805823199s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615836489 (56h52m57.806135079s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616131383 (56h52m57.806429964s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616416900 (56h52m57.806715483s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616716123 (56h52m57.807014706s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:27.286742660 (56h52m58.477041242s) [upload=54558]: Next returned nil segment Jul 26 20:28:27.286763668 (56h52m58.477062307s) [upload=54558]: Waiting for error group managing segments... Jul 26 20:28:27.422423022 (56h52m58.612721587s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.550290566 (56h52m58.740589135s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.758451628 (56h52m58.948750195s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.763539754 (56h52m58.953838348s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.764479628 (56h52m58.954778197s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770394756 (56h52m58.960693336s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770582294 (56h52m58.960880874s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.774778478 (56h52m58.965077045s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.784509808 (56h52m58.974808374s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.794987896 (56h52m58.985286468s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:28.312192063 (56h52m59.502490639s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:56.210272411 (56h53m27.40057099s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50304->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210363923 (56h53m27.400662505s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: rpc: dial tcp 45.91.116.12:4226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210426568 (56h53m27.400725148s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210483041 (56h53m27.40078162s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 139.59.144.22:35884->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210617764 (56h53m27.400916346s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:56.210643671 (56h53m27.400942269s) [seg_pos={0 0}, upload=54558]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 26 20:28:56.316670597 (56h53m27.506969171s) [upload=54558]: Done uploading segments... Jul 26 20:28:56.316701523 (56h53m27.507000104s) [upload=54558]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.524398736s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.345935295s FAIL (2025-07-26 21:13:15 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.345977565s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 2.317633291s FAIL (2025-07-26 21:12:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== rue , address=45.91.116.6:4975 , piece_id=VG5RNI2Z6A6FGM7I6WHCNJJIMZUNXKEXYNT367PJEN756GSYLXCQ, seg_pos={0 0}, upload=54545]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:05.089846946 (56h52m36.280145528s) [seg_pos={0 0}, upload=54545]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 26 20:28:05.204635709 (56h52m36.394934281s) [upload=54545]: Done uploading segments... Jul 26 20:28:05.204661999 (56h52m36.394960579s) [upload=54545]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Jul 26 20:28:26.499846533 (56h52m57.690145103s) [upload=54558]: Starting upload Jul 26 20:28:26.499918833 (56h52m57.690217403s) [upload=54558]: Done starting upload Jul 26 20:28:26.499982310 (56h52m57.690280894s) [upload=54558]: Uploading segments... Jul 26 20:28:26.500267631 (56h52m57.690566217s) [upload=54558]: Got next segment. Inline: false Jul 26 20:28:26.500323092 (56h52m57.690621681s) [upload=54558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 20:28:26.500349824 (56h52m57.690648517s) [upload=54558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 20:28:26.611161117 (56h52m57.801459686s) [seg_pos={0 0}, upload=54558]: Begin upload segment... Jul 26 20:28:26.611211593 (56h52m57.801510173s) [seg_pos={0 0}, upload=54558]: Done begin upload segment. Jul 26 20:28:26.611242346 (56h52m57.801540931s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.611787891 (56h52m57.802086479s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612150870 (56h52m57.802449454s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612502942 (56h52m57.802801528s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612827744 (56h52m57.80312633s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613395709 (56h52m57.803694297s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613836447 (56h52m57.804135041s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614376380 (56h52m57.804674968s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614682063 (56h52m57.804980645s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614954123 (56h52m57.805252705s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615254738 (56h52m57.805553321s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615524618 (56h52m57.805823199s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615836489 (56h52m57.806135079s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616131383 (56h52m57.806429964s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616416900 (56h52m57.806715483s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616716123 (56h52m57.807014706s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:27.286742660 (56h52m58.477041242s) [upload=54558]: Next returned nil segment Jul 26 20:28:27.286763668 (56h52m58.477062307s) [upload=54558]: Waiting for error group managing segments... Jul 26 20:28:27.422423022 (56h52m58.612721587s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.550290566 (56h52m58.740589135s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.758451628 (56h52m58.948750195s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.763539754 (56h52m58.953838348s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.764479628 (56h52m58.954778197s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770394756 (56h52m58.960693336s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770582294 (56h52m58.960880874s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.774778478 (56h52m58.965077045s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.784509808 (56h52m58.974808374s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.794987896 (56h52m58.985286468s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:28.312192063 (56h52m59.502490639s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:56.210272411 (56h53m27.40057099s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50304->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210363923 (56h53m27.400662505s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: rpc: dial tcp 45.91.116.12:4226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210426568 (56h53m27.400725148s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210483041 (56h53m27.40078162s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 139.59.144.22:35884->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210617764 (56h53m27.400916346s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:56.210643671 (56h53m27.400942269s) [seg_pos={0 0}, upload=54558]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 26 20:28:56.316670597 (56h53m27.506969171s) [upload=54558]: Done uploading segments... Jul 26 20:28:56.316701523 (56h53m27.507000104s) [upload=54558]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.317742408s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.435899378s FAIL (2025-07-26 21:12:43 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.435931124s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [X.........................X.................................] duration: 2.320941401s FAIL (2025-07-26 21:12:10 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.320972019s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 3.464743721s FAIL (2025-07-26 21:11:38 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== rue , address=45.91.116.6:4975 , piece_id=VG5RNI2Z6A6FGM7I6WHCNJJIMZUNXKEXYNT367PJEN756GSYLXCQ, seg_pos={0 0}, upload=54545]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:05.089846946 (56h52m36.280145528s) [seg_pos={0 0}, upload=54545]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 26 20:28:05.204635709 (56h52m36.394934281s) [upload=54545]: Done uploading segments... Jul 26 20:28:05.204661999 (56h52m36.394960579s) [upload=54545]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Jul 26 20:28:26.499846533 (56h52m57.690145103s) [upload=54558]: Starting upload Jul 26 20:28:26.499918833 (56h52m57.690217403s) [upload=54558]: Done starting upload Jul 26 20:28:26.499982310 (56h52m57.690280894s) [upload=54558]: Uploading segments... Jul 26 20:28:26.500267631 (56h52m57.690566217s) [upload=54558]: Got next segment. Inline: false Jul 26 20:28:26.500323092 (56h52m57.690621681s) [upload=54558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 20:28:26.500349824 (56h52m57.690648517s) [upload=54558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 20:28:26.611161117 (56h52m57.801459686s) [seg_pos={0 0}, upload=54558]: Begin upload segment... Jul 26 20:28:26.611211593 (56h52m57.801510173s) [seg_pos={0 0}, upload=54558]: Done begin upload segment. Jul 26 20:28:26.611242346 (56h52m57.801540931s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.611787891 (56h52m57.802086479s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612150870 (56h52m57.802449454s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612502942 (56h52m57.802801528s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612827744 (56h52m57.80312633s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613395709 (56h52m57.803694297s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613836447 (56h52m57.804135041s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614376380 (56h52m57.804674968s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614682063 (56h52m57.804980645s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614954123 (56h52m57.805252705s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615254738 (56h52m57.805553321s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615524618 (56h52m57.805823199s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615836489 (56h52m57.806135079s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616131383 (56h52m57.806429964s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616416900 (56h52m57.806715483s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616716123 (56h52m57.807014706s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:27.286742660 (56h52m58.477041242s) [upload=54558]: Next returned nil segment Jul 26 20:28:27.286763668 (56h52m58.477062307s) [upload=54558]: Waiting for error group managing segments... Jul 26 20:28:27.422423022 (56h52m58.612721587s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.550290566 (56h52m58.740589135s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.758451628 (56h52m58.948750195s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.763539754 (56h52m58.953838348s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.764479628 (56h52m58.954778197s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770394756 (56h52m58.960693336s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770582294 (56h52m58.960880874s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.774778478 (56h52m58.965077045s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.784509808 (56h52m58.974808374s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.794987896 (56h52m58.985286468s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:28.312192063 (56h52m59.502490639s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:56.210272411 (56h53m27.40057099s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50304->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210363923 (56h53m27.400662505s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: rpc: dial tcp 45.91.116.12:4226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210426568 (56h53m27.400725148s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210483041 (56h53m27.40078162s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 139.59.144.22:35884->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210617764 (56h53m27.400916346s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:56.210643671 (56h53m27.400942269s) [seg_pos={0 0}, upload=54558]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 26 20:28:56.316670597 (56h53m27.506969171s) [upload=54558]: Done uploading segments... Jul 26 20:28:56.316701523 (56h53m27.507000104s) [upload=54558]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 3.464775132s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X.........................X................................] duration: 3.257829395s FAIL (2025-07-26 21:11:26 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 3.2578722s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 3.824465803s FAIL (2025-07-26 21:11:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== rue , address=45.91.116.6:4975 , piece_id=VG5RNI2Z6A6FGM7I6WHCNJJIMZUNXKEXYNT367PJEN756GSYLXCQ, seg_pos={0 0}, upload=54545]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:05.089846946 (56h52m36.280145528s) [seg_pos={0 0}, upload=54545]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 26 20:28:05.204635709 (56h52m36.394934281s) [upload=54545]: Done uploading segments... Jul 26 20:28:05.204661999 (56h52m36.394960579s) [upload=54545]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Jul 26 20:28:26.499846533 (56h52m57.690145103s) [upload=54558]: Starting upload Jul 26 20:28:26.499918833 (56h52m57.690217403s) [upload=54558]: Done starting upload Jul 26 20:28:26.499982310 (56h52m57.690280894s) [upload=54558]: Uploading segments... Jul 26 20:28:26.500267631 (56h52m57.690566217s) [upload=54558]: Got next segment. Inline: false Jul 26 20:28:26.500323092 (56h52m57.690621681s) [upload=54558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 20:28:26.500349824 (56h52m57.690648517s) [upload=54558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 20:28:26.611161117 (56h52m57.801459686s) [seg_pos={0 0}, upload=54558]: Begin upload segment... Jul 26 20:28:26.611211593 (56h52m57.801510173s) [seg_pos={0 0}, upload=54558]: Done begin upload segment. Jul 26 20:28:26.611242346 (56h52m57.801540931s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.611787891 (56h52m57.802086479s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612150870 (56h52m57.802449454s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612502942 (56h52m57.802801528s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612827744 (56h52m57.80312633s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613395709 (56h52m57.803694297s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613836447 (56h52m57.804135041s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614376380 (56h52m57.804674968s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614682063 (56h52m57.804980645s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614954123 (56h52m57.805252705s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615254738 (56h52m57.805553321s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615524618 (56h52m57.805823199s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615836489 (56h52m57.806135079s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616131383 (56h52m57.806429964s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616416900 (56h52m57.806715483s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616716123 (56h52m57.807014706s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:27.286742660 (56h52m58.477041242s) [upload=54558]: Next returned nil segment Jul 26 20:28:27.286763668 (56h52m58.477062307s) [upload=54558]: Waiting for error group managing segments... Jul 26 20:28:27.422423022 (56h52m58.612721587s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.550290566 (56h52m58.740589135s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.758451628 (56h52m58.948750195s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.763539754 (56h52m58.953838348s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.764479628 (56h52m58.954778197s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770394756 (56h52m58.960693336s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770582294 (56h52m58.960880874s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.774778478 (56h52m58.965077045s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.784509808 (56h52m58.974808374s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.794987896 (56h52m58.985286468s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:28.312192063 (56h52m59.502490639s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:56.210272411 (56h53m27.40057099s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50304->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210363923 (56h53m27.400662505s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: rpc: dial tcp 45.91.116.12:4226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210426568 (56h53m27.400725148s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210483041 (56h53m27.40078162s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 139.59.144.22:35884->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210617764 (56h53m27.400916346s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:56.210643671 (56h53m27.400942269s) [seg_pos={0 0}, upload=54558]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 26 20:28:56.316670597 (56h53m27.506969171s) [upload=54558]: Done uploading segments... Jul 26 20:28:56.316701523 (56h53m27.507000104s) [upload=54558]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 3.824505345s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X.........................X...............................] duration: 2.574406393s FAIL (2025-07-26 21:10:42 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.57443786s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...XX.......................................................] duration: 2.388896596s FAIL (2025-07-26 21:10:24 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== rue , address=45.91.116.6:4975 , piece_id=VG5RNI2Z6A6FGM7I6WHCNJJIMZUNXKEXYNT367PJEN756GSYLXCQ, seg_pos={0 0}, upload=54545]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:05.089846946 (56h52m36.280145528s) [seg_pos={0 0}, upload=54545]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 26 20:28:05.204635709 (56h52m36.394934281s) [upload=54545]: Done uploading segments... Jul 26 20:28:05.204661999 (56h52m36.394960579s) [upload=54545]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Jul 26 20:28:26.499846533 (56h52m57.690145103s) [upload=54558]: Starting upload Jul 26 20:28:26.499918833 (56h52m57.690217403s) [upload=54558]: Done starting upload Jul 26 20:28:26.499982310 (56h52m57.690280894s) [upload=54558]: Uploading segments... Jul 26 20:28:26.500267631 (56h52m57.690566217s) [upload=54558]: Got next segment. Inline: false Jul 26 20:28:26.500323092 (56h52m57.690621681s) [upload=54558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 20:28:26.500349824 (56h52m57.690648517s) [upload=54558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 20:28:26.611161117 (56h52m57.801459686s) [seg_pos={0 0}, upload=54558]: Begin upload segment... Jul 26 20:28:26.611211593 (56h52m57.801510173s) [seg_pos={0 0}, upload=54558]: Done begin upload segment. Jul 26 20:28:26.611242346 (56h52m57.801540931s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.611787891 (56h52m57.802086479s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612150870 (56h52m57.802449454s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612502942 (56h52m57.802801528s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612827744 (56h52m57.80312633s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613395709 (56h52m57.803694297s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613836447 (56h52m57.804135041s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614376380 (56h52m57.804674968s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614682063 (56h52m57.804980645s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614954123 (56h52m57.805252705s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615254738 (56h52m57.805553321s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615524618 (56h52m57.805823199s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615836489 (56h52m57.806135079s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616131383 (56h52m57.806429964s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616416900 (56h52m57.806715483s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616716123 (56h52m57.807014706s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:27.286742660 (56h52m58.477041242s) [upload=54558]: Next returned nil segment Jul 26 20:28:27.286763668 (56h52m58.477062307s) [upload=54558]: Waiting for error group managing segments... Jul 26 20:28:27.422423022 (56h52m58.612721587s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.550290566 (56h52m58.740589135s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.758451628 (56h52m58.948750195s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.763539754 (56h52m58.953838348s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.764479628 (56h52m58.954778197s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770394756 (56h52m58.960693336s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770582294 (56h52m58.960880874s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.774778478 (56h52m58.965077045s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.784509808 (56h52m58.974808374s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.794987896 (56h52m58.985286468s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:28.312192063 (56h52m59.502490639s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:56.210272411 (56h53m27.40057099s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50304->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210363923 (56h53m27.400662505s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: rpc: dial tcp 45.91.116.12:4226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210426568 (56h53m27.400725148s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210483041 (56h53m27.40078162s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 139.59.144.22:35884->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210617764 (56h53m27.400916346s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:56.210643671 (56h53m27.400942269s) [seg_pos={0 0}, upload=54558]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 26 20:28:56.316670597 (56h53m27.506969171s) [upload=54558]: Done uploading segments... Jul 26 20:28:56.316701523 (56h53m27.507000104s) [upload=54558]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.388928951s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X.........................X..............................] duration: 3.078558341s FAIL (2025-07-26 21:10:09 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 3.078618096s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....XX......................................................] duration: 2.456962644s FAIL (2025-07-26 21:09:54 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== rue , address=45.91.116.6:4975 , piece_id=VG5RNI2Z6A6FGM7I6WHCNJJIMZUNXKEXYNT367PJEN756GSYLXCQ, seg_pos={0 0}, upload=54545]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:05.089846946 (56h52m36.280145528s) [seg_pos={0 0}, upload=54545]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 26 20:28:05.204635709 (56h52m36.394934281s) [upload=54545]: Done uploading segments... Jul 26 20:28:05.204661999 (56h52m36.394960579s) [upload=54545]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Jul 26 20:28:26.499846533 (56h52m57.690145103s) [upload=54558]: Starting upload Jul 26 20:28:26.499918833 (56h52m57.690217403s) [upload=54558]: Done starting upload Jul 26 20:28:26.499982310 (56h52m57.690280894s) [upload=54558]: Uploading segments... Jul 26 20:28:26.500267631 (56h52m57.690566217s) [upload=54558]: Got next segment. Inline: false Jul 26 20:28:26.500323092 (56h52m57.690621681s) [upload=54558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 20:28:26.500349824 (56h52m57.690648517s) [upload=54558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 20:28:26.611161117 (56h52m57.801459686s) [seg_pos={0 0}, upload=54558]: Begin upload segment... Jul 26 20:28:26.611211593 (56h52m57.801510173s) [seg_pos={0 0}, upload=54558]: Done begin upload segment. Jul 26 20:28:26.611242346 (56h52m57.801540931s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.611787891 (56h52m57.802086479s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612150870 (56h52m57.802449454s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612502942 (56h52m57.802801528s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612827744 (56h52m57.80312633s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613395709 (56h52m57.803694297s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613836447 (56h52m57.804135041s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614376380 (56h52m57.804674968s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614682063 (56h52m57.804980645s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614954123 (56h52m57.805252705s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615254738 (56h52m57.805553321s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615524618 (56h52m57.805823199s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615836489 (56h52m57.806135079s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616131383 (56h52m57.806429964s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616416900 (56h52m57.806715483s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616716123 (56h52m57.807014706s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:27.286742660 (56h52m58.477041242s) [upload=54558]: Next returned nil segment Jul 26 20:28:27.286763668 (56h52m58.477062307s) [upload=54558]: Waiting for error group managing segments... Jul 26 20:28:27.422423022 (56h52m58.612721587s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.550290566 (56h52m58.740589135s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.758451628 (56h52m58.948750195s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.763539754 (56h52m58.953838348s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.764479628 (56h52m58.954778197s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770394756 (56h52m58.960693336s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770582294 (56h52m58.960880874s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.774778478 (56h52m58.965077045s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.784509808 (56h52m58.974808374s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.794987896 (56h52m58.985286468s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:28.312192063 (56h52m59.502490639s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:56.210272411 (56h53m27.40057099s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50304->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210363923 (56h53m27.400662505s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: rpc: dial tcp 45.91.116.12:4226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210426568 (56h53m27.400725148s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210483041 (56h53m27.40078162s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 139.59.144.22:35884->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210617764 (56h53m27.400916346s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:56.210643671 (56h53m27.400942269s) [seg_pos={0 0}, upload=54558]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 26 20:28:56.316670597 (56h53m27.506969171s) [upload=54558]: Done uploading segments... Jul 26 20:28:56.316701523 (56h53m27.507000104s) [upload=54558]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.457058246s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.898579366s FAIL (2025-07-26 21:09:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.898623461s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X.........................X.............................] duration: 2.323237715s FAIL (2025-07-26 21:09:11 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.323273993s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration: 2.523792063s FAIL (2025-07-26 21:08:47 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== rue , address=45.91.116.6:4975 , piece_id=VG5RNI2Z6A6FGM7I6WHCNJJIMZUNXKEXYNT367PJEN756GSYLXCQ, seg_pos={0 0}, upload=54545]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:05.089846946 (56h52m36.280145528s) [seg_pos={0 0}, upload=54545]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 26 20:28:05.204635709 (56h52m36.394934281s) [upload=54545]: Done uploading segments... Jul 26 20:28:05.204661999 (56h52m36.394960579s) [upload=54545]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Jul 26 20:28:26.499846533 (56h52m57.690145103s) [upload=54558]: Starting upload Jul 26 20:28:26.499918833 (56h52m57.690217403s) [upload=54558]: Done starting upload Jul 26 20:28:26.499982310 (56h52m57.690280894s) [upload=54558]: Uploading segments... Jul 26 20:28:26.500267631 (56h52m57.690566217s) [upload=54558]: Got next segment. Inline: false Jul 26 20:28:26.500323092 (56h52m57.690621681s) [upload=54558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 20:28:26.500349824 (56h52m57.690648517s) [upload=54558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 20:28:26.611161117 (56h52m57.801459686s) [seg_pos={0 0}, upload=54558]: Begin upload segment... Jul 26 20:28:26.611211593 (56h52m57.801510173s) [seg_pos={0 0}, upload=54558]: Done begin upload segment. Jul 26 20:28:26.611242346 (56h52m57.801540931s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.611787891 (56h52m57.802086479s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612150870 (56h52m57.802449454s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612502942 (56h52m57.802801528s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612827744 (56h52m57.80312633s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613395709 (56h52m57.803694297s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613836447 (56h52m57.804135041s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614376380 (56h52m57.804674968s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614682063 (56h52m57.804980645s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614954123 (56h52m57.805252705s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615254738 (56h52m57.805553321s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615524618 (56h52m57.805823199s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615836489 (56h52m57.806135079s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616131383 (56h52m57.806429964s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616416900 (56h52m57.806715483s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616716123 (56h52m57.807014706s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:27.286742660 (56h52m58.477041242s) [upload=54558]: Next returned nil segment Jul 26 20:28:27.286763668 (56h52m58.477062307s) [upload=54558]: Waiting for error group managing segments... Jul 26 20:28:27.422423022 (56h52m58.612721587s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.550290566 (56h52m58.740589135s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.758451628 (56h52m58.948750195s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.763539754 (56h52m58.953838348s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.764479628 (56h52m58.954778197s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770394756 (56h52m58.960693336s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770582294 (56h52m58.960880874s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.774778478 (56h52m58.965077045s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.784509808 (56h52m58.974808374s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.794987896 (56h52m58.985286468s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:28.312192063 (56h52m59.502490639s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:56.210272411 (56h53m27.40057099s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50304->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210363923 (56h53m27.400662505s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: rpc: dial tcp 45.91.116.12:4226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210426568 (56h53m27.400725148s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210483041 (56h53m27.40078162s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 139.59.144.22:35884->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210617764 (56h53m27.400916346s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:56.210643671 (56h53m27.400942269s) [seg_pos={0 0}, upload=54558]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 26 20:28:56.316670597 (56h53m27.506969171s) [upload=54558]: Done uploading segments... Jul 26 20:28:56.316701523 (56h53m27.507000104s) [upload=54558]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.523820545s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X.........................X............................] duration: 2.740619704s FAIL (2025-07-26 21:08:28 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.740662831s core uplink us1 vivint
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.99017887s FAIL (2025-07-26 21:08:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.990283437s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.661203658s FAIL (2025-07-26 21:07:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.661231022s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......XX....................................................] duration: 2.673134247s FAIL (2025-07-26 21:07:39 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== rue , address=45.91.116.6:4975 , piece_id=VG5RNI2Z6A6FGM7I6WHCNJJIMZUNXKEXYNT367PJEN756GSYLXCQ, seg_pos={0 0}, upload=54545]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:05.089846946 (56h52m36.280145528s) [seg_pos={0 0}, upload=54545]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 26 20:28:05.204635709 (56h52m36.394934281s) [upload=54545]: Done uploading segments... Jul 26 20:28:05.204661999 (56h52m36.394960579s) [upload=54545]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Jul 26 20:28:26.499846533 (56h52m57.690145103s) [upload=54558]: Starting upload Jul 26 20:28:26.499918833 (56h52m57.690217403s) [upload=54558]: Done starting upload Jul 26 20:28:26.499982310 (56h52m57.690280894s) [upload=54558]: Uploading segments... Jul 26 20:28:26.500267631 (56h52m57.690566217s) [upload=54558]: Got next segment. Inline: false Jul 26 20:28:26.500323092 (56h52m57.690621681s) [upload=54558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 20:28:26.500349824 (56h52m57.690648517s) [upload=54558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 20:28:26.611161117 (56h52m57.801459686s) [seg_pos={0 0}, upload=54558]: Begin upload segment... Jul 26 20:28:26.611211593 (56h52m57.801510173s) [seg_pos={0 0}, upload=54558]: Done begin upload segment. Jul 26 20:28:26.611242346 (56h52m57.801540931s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.611787891 (56h52m57.802086479s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612150870 (56h52m57.802449454s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612502942 (56h52m57.802801528s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612827744 (56h52m57.80312633s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613395709 (56h52m57.803694297s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613836447 (56h52m57.804135041s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614376380 (56h52m57.804674968s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614682063 (56h52m57.804980645s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614954123 (56h52m57.805252705s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615254738 (56h52m57.805553321s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615524618 (56h52m57.805823199s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615836489 (56h52m57.806135079s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616131383 (56h52m57.806429964s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616416900 (56h52m57.806715483s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616716123 (56h52m57.807014706s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:27.286742660 (56h52m58.477041242s) [upload=54558]: Next returned nil segment Jul 26 20:28:27.286763668 (56h52m58.477062307s) [upload=54558]: Waiting for error group managing segments... Jul 26 20:28:27.422423022 (56h52m58.612721587s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.550290566 (56h52m58.740589135s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.758451628 (56h52m58.948750195s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.763539754 (56h52m58.953838348s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.764479628 (56h52m58.954778197s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770394756 (56h52m58.960693336s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770582294 (56h52m58.960880874s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.774778478 (56h52m58.965077045s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.784509808 (56h52m58.974808374s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.794987896 (56h52m58.985286468s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:28.312192063 (56h52m59.502490639s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:56.210272411 (56h53m27.40057099s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50304->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210363923 (56h53m27.400662505s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: rpc: dial tcp 45.91.116.12:4226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210426568 (56h53m27.400725148s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210483041 (56h53m27.40078162s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 139.59.144.22:35884->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210617764 (56h53m27.400916346s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:56.210643671 (56h53m27.400942269s) [seg_pos={0 0}, upload=54558]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 26 20:28:56.316670597 (56h53m27.506969171s) [upload=54558]: Done uploading segments... Jul 26 20:28:56.316701523 (56h53m27.507000104s) [upload=54558]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.67323337s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X.........................X...........................] duration: 2.406574759s FAIL (2025-07-26 21:07:35 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.406623256s core uplink us1 vivint
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 4.675238088s FAIL (2025-07-26 21:07:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.675264779s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X.........................X..........................] duration: 2.483873102s FAIL (2025-07-26 21:07:09 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.483903576s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......XX...................................................] duration: 5.76591122s FAIL (2025-07-26 21:06:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== rue , address=45.91.116.6:4975 , piece_id=VG5RNI2Z6A6FGM7I6WHCNJJIMZUNXKEXYNT367PJEN756GSYLXCQ, seg_pos={0 0}, upload=54545]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:05.089846946 (56h52m36.280145528s) [seg_pos={0 0}, upload=54545]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 26 20:28:05.204635709 (56h52m36.394934281s) [upload=54545]: Done uploading segments... Jul 26 20:28:05.204661999 (56h52m36.394960579s) [upload=54545]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Jul 26 20:28:26.499846533 (56h52m57.690145103s) [upload=54558]: Starting upload Jul 26 20:28:26.499918833 (56h52m57.690217403s) [upload=54558]: Done starting upload Jul 26 20:28:26.499982310 (56h52m57.690280894s) [upload=54558]: Uploading segments... Jul 26 20:28:26.500267631 (56h52m57.690566217s) [upload=54558]: Got next segment. Inline: false Jul 26 20:28:26.500323092 (56h52m57.690621681s) [upload=54558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 20:28:26.500349824 (56h52m57.690648517s) [upload=54558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 20:28:26.611161117 (56h52m57.801459686s) [seg_pos={0 0}, upload=54558]: Begin upload segment... Jul 26 20:28:26.611211593 (56h52m57.801510173s) [seg_pos={0 0}, upload=54558]: Done begin upload segment. Jul 26 20:28:26.611242346 (56h52m57.801540931s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.611787891 (56h52m57.802086479s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612150870 (56h52m57.802449454s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612502942 (56h52m57.802801528s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612827744 (56h52m57.80312633s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613395709 (56h52m57.803694297s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613836447 (56h52m57.804135041s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614376380 (56h52m57.804674968s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614682063 (56h52m57.804980645s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614954123 (56h52m57.805252705s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615254738 (56h52m57.805553321s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615524618 (56h52m57.805823199s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615836489 (56h52m57.806135079s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616131383 (56h52m57.806429964s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616416900 (56h52m57.806715483s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616716123 (56h52m57.807014706s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:27.286742660 (56h52m58.477041242s) [upload=54558]: Next returned nil segment Jul 26 20:28:27.286763668 (56h52m58.477062307s) [upload=54558]: Waiting for error group managing segments... Jul 26 20:28:27.422423022 (56h52m58.612721587s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.550290566 (56h52m58.740589135s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.758451628 (56h52m58.948750195s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.763539754 (56h52m58.953838348s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.764479628 (56h52m58.954778197s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770394756 (56h52m58.960693336s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770582294 (56h52m58.960880874s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.774778478 (56h52m58.965077045s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.784509808 (56h52m58.974808374s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.794987896 (56h52m58.985286468s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:28.312192063 (56h52m59.502490639s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:56.210272411 (56h53m27.40057099s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50304->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210363923 (56h53m27.400662505s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: rpc: dial tcp 45.91.116.12:4226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210426568 (56h53m27.400725148s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210483041 (56h53m27.40078162s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 139.59.144.22:35884->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210617764 (56h53m27.400916346s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:56.210643671 (56h53m27.400942269s) [seg_pos={0 0}, upload=54558]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 26 20:28:56.316670597 (56h53m27.506969171s) [upload=54558]: Done uploading segments... Jul 26 20:28:56.316701523 (56h53m27.507000104s) [upload=54558]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.765945095s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X.........................X.........................] duration: 3.071913302s FAIL (2025-07-26 21:06:35 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 3.07195136s core uplink us1 vivint
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.873289785s FAIL (2025-07-26 21:06:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.873320922s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.945320898s FAIL (2025-07-26 21:05:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.94535551s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X.........................X........................] duration: 2.305214879s FAIL (2025-07-26 21:05:37 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.305252292s core uplink us1 vivint
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.918230898s FAIL (2025-07-26 21:05:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.918260592s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........XX..................................................] duration: 3.214845458s FAIL (2025-07-26 21:05:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== rue , address=45.91.116.6:4975 , piece_id=VG5RNI2Z6A6FGM7I6WHCNJJIMZUNXKEXYNT367PJEN756GSYLXCQ, seg_pos={0 0}, upload=54545]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:05.089846946 (56h52m36.280145528s) [seg_pos={0 0}, upload=54545]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 26 20:28:05.204635709 (56h52m36.394934281s) [upload=54545]: Done uploading segments... Jul 26 20:28:05.204661999 (56h52m36.394960579s) [upload=54545]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Jul 26 20:28:26.499846533 (56h52m57.690145103s) [upload=54558]: Starting upload Jul 26 20:28:26.499918833 (56h52m57.690217403s) [upload=54558]: Done starting upload Jul 26 20:28:26.499982310 (56h52m57.690280894s) [upload=54558]: Uploading segments... Jul 26 20:28:26.500267631 (56h52m57.690566217s) [upload=54558]: Got next segment. Inline: false Jul 26 20:28:26.500323092 (56h52m57.690621681s) [upload=54558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 20:28:26.500349824 (56h52m57.690648517s) [upload=54558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 20:28:26.611161117 (56h52m57.801459686s) [seg_pos={0 0}, upload=54558]: Begin upload segment... Jul 26 20:28:26.611211593 (56h52m57.801510173s) [seg_pos={0 0}, upload=54558]: Done begin upload segment. Jul 26 20:28:26.611242346 (56h52m57.801540931s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.611787891 (56h52m57.802086479s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612150870 (56h52m57.802449454s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612502942 (56h52m57.802801528s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612827744 (56h52m57.80312633s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613395709 (56h52m57.803694297s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613836447 (56h52m57.804135041s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614376380 (56h52m57.804674968s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614682063 (56h52m57.804980645s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614954123 (56h52m57.805252705s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615254738 (56h52m57.805553321s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615524618 (56h52m57.805823199s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615836489 (56h52m57.806135079s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616131383 (56h52m57.806429964s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616416900 (56h52m57.806715483s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616716123 (56h52m57.807014706s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:27.286742660 (56h52m58.477041242s) [upload=54558]: Next returned nil segment Jul 26 20:28:27.286763668 (56h52m58.477062307s) [upload=54558]: Waiting for error group managing segments... Jul 26 20:28:27.422423022 (56h52m58.612721587s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.550290566 (56h52m58.740589135s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.758451628 (56h52m58.948750195s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.763539754 (56h52m58.953838348s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.764479628 (56h52m58.954778197s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770394756 (56h52m58.960693336s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770582294 (56h52m58.960880874s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.774778478 (56h52m58.965077045s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.784509808 (56h52m58.974808374s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.794987896 (56h52m58.985286468s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:28.312192063 (56h52m59.502490639s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:56.210272411 (56h53m27.40057099s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50304->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210363923 (56h53m27.400662505s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: rpc: dial tcp 45.91.116.12:4226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210426568 (56h53m27.400725148s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210483041 (56h53m27.40078162s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 139.59.144.22:35884->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210617764 (56h53m27.400916346s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:56.210643671 (56h53m27.400942269s) [seg_pos={0 0}, upload=54558]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 26 20:28:56.316670597 (56h53m27.506969171s) [upload=54558]: Done uploading segments... Jul 26 20:28:56.316701523 (56h53m27.507000104s) [upload=54558]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 3.214875092s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X.........................X.......................] duration: 2.430057057s FAIL (2025-07-26 21:04:51 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.430087434s core uplink us1 vivint
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.735438185s FAIL (2025-07-26 21:04:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.735474991s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........XX.................................................] duration: 2.991221449s FAIL (2025-07-26 21:04:21 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== rue , address=45.91.116.6:4975 , piece_id=VG5RNI2Z6A6FGM7I6WHCNJJIMZUNXKEXYNT367PJEN756GSYLXCQ, seg_pos={0 0}, upload=54545]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:05.089846946 (56h52m36.280145528s) [seg_pos={0 0}, upload=54545]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Jul 26 20:28:05.204635709 (56h52m36.394934281s) [upload=54545]: Done uploading segments... Jul 26 20:28:05.204661999 (56h52m36.394960579s) [upload=54545]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Jul 26 20:28:26.499846533 (56h52m57.690145103s) [upload=54558]: Starting upload Jul 26 20:28:26.499918833 (56h52m57.690217403s) [upload=54558]: Done starting upload Jul 26 20:28:26.499982310 (56h52m57.690280894s) [upload=54558]: Uploading segments... Jul 26 20:28:26.500267631 (56h52m57.690566217s) [upload=54558]: Got next segment. Inline: false Jul 26 20:28:26.500323092 (56h52m57.690621681s) [upload=54558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 26 20:28:26.500349824 (56h52m57.690648517s) [upload=54558]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 26 20:28:26.611161117 (56h52m57.801459686s) [seg_pos={0 0}, upload=54558]: Begin upload segment... Jul 26 20:28:26.611211593 (56h52m57.801510173s) [seg_pos={0 0}, upload=54558]: Done begin upload segment. Jul 26 20:28:26.611242346 (56h52m57.801540931s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.611787891 (56h52m57.802086479s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612150870 (56h52m57.802449454s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612502942 (56h52m57.802801528s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.612827744 (56h52m57.80312633s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613395709 (56h52m57.803694297s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.613836447 (56h52m57.804135041s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614376380 (56h52m57.804674968s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614682063 (56h52m57.804980645s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.614954123 (56h52m57.805252705s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615254738 (56h52m57.805553321s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615524618 (56h52m57.805823199s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.615836489 (56h52m57.806135079s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616131383 (56h52m57.806429964s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616416900 (56h52m57.806715483s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:26.616716123 (56h52m57.807014706s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Uploading piece... Jul 26 20:28:27.286742660 (56h52m58.477041242s) [upload=54558]: Next returned nil segment Jul 26 20:28:27.286763668 (56h52m58.477062307s) [upload=54558]: Waiting for error group managing segments... Jul 26 20:28:27.422423022 (56h52m58.612721587s) [noise=true , address=104.36.82.4:4801 , piece_id=YPVDYP6TGDVT4E34GWGTPECGZJGIQ3P5A6G57TFJZGFQRLSCLQOA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.550290566 (56h52m58.740589135s) [noise=true , address=104.36.82.13:4187 , piece_id=XLSRJLP5W5AWXAPJNSEND2KYHN7K2LUPFAL5FOSZUF7KB4OHG2CA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.758451628 (56h52m58.948750195s) [noise=true , address=77.90.31.17:4772 , piece_id=32G6AMIJKMU5VDXP3ZSSZ7SY33KDA23K6X3VBZQGEBNSC67CA7WA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.763539754 (56h52m58.953838348s) [noise=true , address=77.90.31.11:4553 , piece_id=RMNEKQ2PCBE2XBZOJDNBT6DBAHRSNNRXP5G7ADW72UJKABXND4IQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.764479628 (56h52m58.954778197s) [noise=true , address=77.90.31.17:4770 , piece_id=W2NFAQBOT4BZSVU3UJDY4AJDSHA23SZWXEAPNUJ7NKFAMPP6H2KQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770394756 (56h52m58.960693336s) [noise=true , address=77.90.31.14:4661 , piece_id=ONNRZLCBQ4CO63XLWSL3OTTDFJ4RLZRG4LFOGYXHJCQRGGIE6L7A, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.770582294 (56h52m58.960880874s) [noise=true , address=77.90.31.12:4590 , piece_id=KBLBOWE7S6FJWKRUVSSM4NXQNMBYJV3F6CAU5CF4KU5A2GQIFCAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.774778478 (56h52m58.965077045s) [noise=true , address=77.90.31.18:4807 , piece_id=KXNRMEBIRPDBXTEB3MQLLWS74DGNKZLOFIBT3UJ6DXSDU4GUK5LA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.784509808 (56h52m58.974808374s) [noise=true , address=77.90.31.10:4517 , piece_id=KK57275YUDHYLD4ORJFC5XX2CWQXHEFB3LHHWHHSJYUR2U3SBRLA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:27.794987896 (56h52m58.985286468s) [noise=true , address=77.90.31.16:4734 , piece_id=3FEPD2DWABI3TUGTVRNNKDLQ43TBMEWGWZYXR6RNDEJNEUNEFROQ, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:28.312192063 (56h52m59.502490639s) [noise=true , address=104.36.82.10:4079 , piece_id=SJAJ57TGXXGIA7QKYDP3O42T7LSI76E3HF6TDNCMBEYTRU6AVWNA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: <nil> Jul 26 20:28:56.210272411 (56h53m27.40057099s) [noise=true , address=45.91.116.14:4191 , piece_id=YMFQRI7HQ7JIONHUUBXS34NAQDDHSMDRQBMVWNJFO5G7Y6EDILBA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 139.59.144.22:50304->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210363923 (56h53m27.400662505s) [noise=true , address=45.91.116.12:4226 , piece_id=DLPQ24VJRGDKNEZW5V6WXHDJ2L6QPFWXOCE5772ALHPCGT3VSQAA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: rpc: dial tcp 45.91.116.12:4226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210426568 (56h53m27.400725148s) [noise=true , address=45.91.116.14:4190 , piece_id=ERV2BJGSJJ4K6OEIWQ4DF7VQDOOKJ4HPEDYSWDNXHKLD3U6WFWRA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210483041 (56h53m27.40078162s) [noise=true , address=45.91.116.11:4118 , piece_id=D44O4XCV5G3L3WIXVKAAF2QAIMK6DYMKCGMJ5QO2KTLKUSAXJMMA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 139.59.144.22:35884->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 26 20:28:56.210617764 (56h53m27.400916346s) [noise=true , address=45.91.116.13:4153 , piece_id=SDVID3KRFGBD3QFYFW5CJSEY7ACUCYV4E7AD5TVE7JWUG6434HHA, seg_pos={0 0}, upload=54558]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: context deadline exceeded; context deadline exceeded Jul 26 20:28:56.210643671 (56h53m27.400942269s) [seg_pos={0 0}, upload=54558]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 26 20:28:56.316670597 (56h53m27.506969171s) [upload=54558]: Done uploading segments... Jul 26 20:28:56.316701523 (56h53m27.507000104s) [upload=54558]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.991264844s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.746300949s FAIL (2025-07-26 21:04:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.746335514s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)