Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 186686 reports (Page 3520 of 3734)
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
333.402861ms
target:
https://version.storj.io/
FAIL (2025-07-14 22:50:52 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 333.428545ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
1.066130217s
FAIL (2025-07-14 22:50:48 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:48375->127.0.0.1:53: i/o timeout
Duration: 1.066156493s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
291.062052ms
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-07-14 22:50:41 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp: lookup uptime-checks-us-select.s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:50317->127.0.0.1:53: i/o timeout
Duration: 291.092297ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
309.100979ms
FAIL (2025-07-14 22:50:40 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 309.138207ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
634.418144ms
target:
https://us1.storj.io/login
FAIL (2025-07-14 22:50:33 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39510->127.0.0.1:53: i/o timeout
Duration: 634.452021ms core satellite us1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
523.058282ms
target:
https://ap1.storj.io/login
FAIL (2025-07-14 22:50:31 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:40128->127.0.0.1:53: i/o timeout
Duration: 523.085275ms core satellite ap1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
2.744715817s
FAIL (2025-07-14 22:50:27 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 2.744741242s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
2 out of 60 is failed (threshold=3) [..............................................XX............]
duration:
579.41258ms
FAIL (2025-07-14 22:50:24 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 579.448747ms edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
355.39403ms
FAIL (2025-07-14 22:50:21 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 355.42414ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
901.45192ms
FAIL (2025-07-14 22:50:20 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 901.4901ms core uplink us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
3.183267063s
FAIL (2025-07-14 22:50:15 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 3.183292589s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
2.369289539s
FAIL (2025-07-14 22:50:12 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731     , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments...
Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil>
Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload
Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload
Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments...
Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false
Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment...
Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment.
Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114    , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627     , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079    , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940     , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047     , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975     , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771     , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186    , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006     , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699     , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734     , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221    , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007     , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293    , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878     , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222    , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment
Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments...
Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221    , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007     , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186    , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222    , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079    , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293    , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006     , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114    , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878     , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771     , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699     , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975     , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940     , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces.
Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627     , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734     , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047     , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments...
Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil>
Duration: 2.369315855s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
333.3904ms
target:
https://version.storj.io/
FAIL (2025-07-14 22:50:12 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 333.411074ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
2.551322458s
FAIL (2025-07-14 22:50:11 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:45099->127.0.0.1:53: i/o timeout
Duration: 2.551358326s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
743.668999ms
FAIL (2025-07-14 22:50:08 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 743.697023ms edge authservice http bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
1.096078487s
FAIL (2025-07-14 22:49:58 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.096105678s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
309.846238ms
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-07-14 22:49:55 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp: lookup uptime-checks-us-select.s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:50317->127.0.0.1:53: i/o timeout
Duration: 309.867166ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
2 out of 60 is failed (threshold=3) [............................................XX..............]
duration:
317.036574ms
FAIL (2025-07-14 22:49:52 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 317.078485ms edge authservice http bgp eu1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
334.147243ms
target:
https://version.storj.io/
FAIL (2025-07-14 22:49:50 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 334.175227ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
1.066868081s
FAIL (2025-07-14 22:49:47 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:48375->127.0.0.1:53: i/o timeout
Duration: 1.0668904s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
2.971693644s
FAIL (2025-07-14 22:49:45 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 2.971713621s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
508.276515ms
target:
https://ap1.storj.io/login
FAIL (2025-07-14 22:49:44 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:40128->127.0.0.1:53: i/o timeout
Duration: 508.298156ms core satellite ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
2.704293117s
FAIL (2025-07-14 22:49:37 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:45099->127.0.0.1:53: i/o timeout
Duration: 2.704316546s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
2.356227109s
FAIL (2025-07-14 22:49:34 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731     , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments...
Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil>
Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload
Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload
Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments...
Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false
Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment...
Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment.
Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114    , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627     , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079    , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940     , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047     , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975     , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771     , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186    , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006     , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699     , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734     , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221    , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007     , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293    , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878     , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222    , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment
Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments...
Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221    , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007     , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186    , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222    , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079    , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293    , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006     , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114    , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878     , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771     , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699     , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975     , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940     , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces.
Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627     , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734     , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047     , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments...
Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil>
Duration: 2.356249544s core uplink us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
2 out of 60 is failed (threshold=3) [.............................................XX.............]
duration:
280.083789ms
FAIL (2025-07-14 22:49:27 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 280.111411ms edge authservice http bgp eu1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
271.137526ms
target:
https://us1.storj.io/login
FAIL (2025-07-14 22:49:24 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39510->127.0.0.1:53: i/o timeout
Duration: 271.174794ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
882.012175ms
FAIL (2025-07-14 22:49:22 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 882.041894ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
2.379683269s
FAIL (2025-07-14 22:49:16 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731     , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments...
Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil>
Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload
Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload
Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments...
Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false
Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment...
Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment.
Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114    , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627     , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079    , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940     , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047     , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975     , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771     , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186    , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006     , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699     , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734     , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221    , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007     , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293    , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878     , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222    , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment
Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments...
Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221    , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007     , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186    , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222    , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079    , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293    , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006     , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114    , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878     , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771     , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699     , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975     , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940     , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces.
Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627     , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734     , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047     , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments...
Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil>
Duration: 2.379730356s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
2.801374519s
FAIL (2025-07-14 22:49:13 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 2.801401661s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
3.251590261s
FAIL (2025-07-14 22:49:12 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 3.25166846s core uplink ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
2 out of 60 is failed (threshold=3) [..............................................XX............]
duration:
335.764877ms
FAIL (2025-07-14 22:49:11 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 335.792418ms edge authservice http bgp eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
2 out of 60 is failed (threshold=3) [...............................................XX...........]
duration:
664.765696ms
FAIL (2025-07-14 22:49:10 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 664.793726ms edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
325.976905ms
FAIL (2025-07-14 22:49:08 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 326.00741ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
841.385083ms
FAIL (2025-07-14 22:49:02 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 841.441933ms edge authservice http bgp ap1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................]
duration:
312.255524ms
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-07-14 22:49:00 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp: lookup uptime-checks-us-select.s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:50317->127.0.0.1:53: i/o timeout
Duration: 312.284349ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
1.031760219s
FAIL (2025-07-14 22:48:57 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:48375->127.0.0.1:53: i/o timeout
Duration: 1.031800637s edge gateway us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
534.29344ms
target:
https://ap1.storj.io/login
FAIL (2025-07-14 22:48:47 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:40128->127.0.0.1:53: i/o timeout
Duration: 534.31799ms core satellite ap1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
340.384174ms
FAIL (2025-07-14 22:48:47 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 340.418043ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
2 out of 60 is failed (threshold=3) [................................................XX..........]
duration:
567.006854ms
FAIL (2025-07-14 22:48:47 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 567.038366ms edge authservice http bgp us1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
334.719388ms
target:
https://version.storj.io/
FAIL (2025-07-14 22:48:43 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 334.750461ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
2.977537254s
FAIL (2025-07-14 22:48:36 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 2.977559224s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
307.135968ms
FAIL (2025-07-14 22:48:31 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 307.167142ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
2.82292711s
FAIL (2025-07-14 22:48:30 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:45099->127.0.0.1:53: i/o timeout
Duration: 2.822951432s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
2 out of 60 is failed (threshold=3) [.................................................XX.........]
duration:
547.994144ms
FAIL (2025-07-14 22:48:28 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 548.024405ms edge authservice http bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
938.750898ms
FAIL (2025-07-14 22:48:25 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 938.844412ms core uplink us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
2 out of 60 is failed (threshold=3) [...............................................XX...........]
duration:
837.224948ms
FAIL (2025-07-14 22:48:23 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 837.259737ms edge authservice http bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
2.484733249s
FAIL (2025-07-14 22:48:20 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731     , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments...
Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil>
Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload
Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload
Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments...
Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false
Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment...
Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment.
Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114    , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627     , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079    , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940     , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047     , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975     , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771     , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186    , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006     , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699     , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734     , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221    , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007     , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293    , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878     , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222    , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment
Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments...
Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221    , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007     , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186    , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222    , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079    , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293    , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006     , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114    , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878     , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771     , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699     , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975     , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940     , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces.
Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627     , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734     , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047     , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments...
Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil>
Duration: 2.484767974s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
288.549669ms
target:
https://us1.storj.io/login
FAIL (2025-07-14 22:48:20 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39510->127.0.0.1:53: i/o timeout
Duration: 288.604132ms core satellite us1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
332.71548ms
target:
https://version.storj.io/
FAIL (2025-07-14 22:48:16 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 332.743582ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
1.12540034s
FAIL (2025-07-14 22:48:05 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:48375->127.0.0.1:53: i/o timeout
Duration: 1.125441426s edge gateway us-select-1