Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
333.402861ms target:
https://version.storj.io/
FAIL (2025-07-14 22:50:52 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 333.428545ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.066130217s
FAIL (2025-07-14 22:50:48 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:48375->127.0.0.1:53: i/o timeout
Duration: 1.066156493s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
291.062052ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-07-14 22:50:41 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp: lookup uptime-checks-us-select.s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:50317->127.0.0.1:53: i/o timeout
Duration: 291.092297ms
edge
gateway
vhost
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
309.100979ms
FAIL (2025-07-14 22:50:40 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 309.138207ms
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
634.418144ms target:
https://us1.storj.io/login
FAIL (2025-07-14 22:50:33 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39510->127.0.0.1:53: i/o timeout
Duration: 634.452021ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
523.058282ms target:
https://ap1.storj.io/login
FAIL (2025-07-14 22:50:31 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:40128->127.0.0.1:53: i/o timeout
Duration: 523.085275ms
core
satellite
ap1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.744715817s
FAIL (2025-07-14 22:50:27 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 2.744741242s
core
uplink
us-select-1
us1-placement-20
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
2 out of 60 is failed (threshold=3) [..............................................XX............] duration:
579.41258ms
FAIL (2025-07-14 22:50:24 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 579.448747ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
355.39403ms
FAIL (2025-07-14 22:50:21 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 355.42414ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
901.45192ms
FAIL (2025-07-14 22:50:20 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 901.4901ms
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
3.183267063s
FAIL (2025-07-14 22:50:15 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 3.183292589s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.369289539s
FAIL (2025-07-14 22:50:12 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731 , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments...
Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil>
Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload
Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload
Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments...
Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false
Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment...
Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment.
Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment
Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments...
Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces.
Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments...
Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil>
Duration: 2.369315855s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
333.3904ms target:
https://version.storj.io/
FAIL (2025-07-14 22:50:12 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 333.411074ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.551322458s
FAIL (2025-07-14 22:50:11 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:45099->127.0.0.1:53: i/o timeout
Duration: 2.551358326s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
743.668999ms
FAIL (2025-07-14 22:50:08 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 743.697023ms
edge
authservice
http
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.096078487s
FAIL (2025-07-14 22:49:58 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.096105678s
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
309.846238ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-07-14 22:49:55 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp: lookup uptime-checks-us-select.s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:50317->127.0.0.1:53: i/o timeout
Duration: 309.867166ms
edge
gateway
vhost
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
2 out of 60 is failed (threshold=3) [............................................XX..............] duration:
317.036574ms
FAIL (2025-07-14 22:49:52 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 317.078485ms
edge
authservice
http
bgp
eu1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
334.147243ms target:
https://version.storj.io/
FAIL (2025-07-14 22:49:50 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 334.175227ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.066868081s
FAIL (2025-07-14 22:49:47 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:48375->127.0.0.1:53: i/o timeout
Duration: 1.0668904s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.971693644s
FAIL (2025-07-14 22:49:45 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 2.971713621s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
508.276515ms target:
https://ap1.storj.io/login
FAIL (2025-07-14 22:49:44 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:40128->127.0.0.1:53: i/o timeout
Duration: 508.298156ms
core
satellite
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.704293117s
FAIL (2025-07-14 22:49:37 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:45099->127.0.0.1:53: i/o timeout
Duration: 2.704316546s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.356227109s
FAIL (2025-07-14 22:49:34 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731 , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments...
Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil>
Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload
Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload
Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments...
Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false
Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment...
Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment.
Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment
Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments...
Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces.
Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments...
Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil>
Duration: 2.356249544s
core
uplink
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
2 out of 60 is failed (threshold=3) [.............................................XX.............] duration:
280.083789ms
FAIL (2025-07-14 22:49:27 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 280.111411ms
edge
authservice
http
bgp
eu1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
271.137526ms target:
https://us1.storj.io/login
FAIL (2025-07-14 22:49:24 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39510->127.0.0.1:53: i/o timeout
Duration: 271.174794ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
882.012175ms
FAIL (2025-07-14 22:49:22 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 882.041894ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.379683269s
FAIL (2025-07-14 22:49:16 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731 , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments...
Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil>
Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload
Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload
Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments...
Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false
Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment...
Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment.
Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment
Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments...
Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces.
Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments...
Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil>
Duration: 2.379730356s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.801374519s
FAIL (2025-07-14 22:49:13 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 2.801401661s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
3.251590261s
FAIL (2025-07-14 22:49:12 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 3.25166846s
core
uplink
ap1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
2 out of 60 is failed (threshold=3) [..............................................XX............] duration:
335.764877ms
FAIL (2025-07-14 22:49:11 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 335.792418ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
2 out of 60 is failed (threshold=3) [...............................................XX...........] duration:
664.765696ms
FAIL (2025-07-14 22:49:10 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 664.793726ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
325.976905ms
FAIL (2025-07-14 22:49:08 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 326.00741ms
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
841.385083ms
FAIL (2025-07-14 22:49:02 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 841.441933ms
edge
authservice
http
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
312.255524ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-07-14 22:49:00 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp: lookup uptime-checks-us-select.s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:50317->127.0.0.1:53: i/o timeout
Duration: 312.284349ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.031760219s
FAIL (2025-07-14 22:48:57 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:48375->127.0.0.1:53: i/o timeout
Duration: 1.031800637s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
534.29344ms target:
https://ap1.storj.io/login
FAIL (2025-07-14 22:48:47 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:40128->127.0.0.1:53: i/o timeout
Duration: 534.31799ms
core
satellite
ap1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
340.384174ms
FAIL (2025-07-14 22:48:47 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 340.418043ms
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
2 out of 60 is failed (threshold=3) [................................................XX..........] duration:
567.006854ms
FAIL (2025-07-14 22:48:47 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 567.038366ms
edge
authservice
http
bgp
us1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
334.719388ms target:
https://version.storj.io/
FAIL (2025-07-14 22:48:43 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 334.750461ms
core
website
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.977537254s
FAIL (2025-07-14 22:48:36 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 2.977559224s
core
uplink
us-select-1
us1-placement-20
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
307.135968ms
FAIL (2025-07-14 22:48:31 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 307.167142ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.82292711s
FAIL (2025-07-14 22:48:30 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:45099->127.0.0.1:53: i/o timeout
Duration: 2.822951432s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
2 out of 60 is failed (threshold=3) [.................................................XX.........] duration:
547.994144ms
FAIL (2025-07-14 22:48:28 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 548.024405ms
edge
authservice
http
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
938.750898ms
FAIL (2025-07-14 22:48:25 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 938.844412ms
core
uplink
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
2 out of 60 is failed (threshold=3) [...............................................XX...........] duration:
837.224948ms
FAIL (2025-07-14 22:48:23 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 837.259737ms
edge
authservice
http
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.484733249s
FAIL (2025-07-14 22:48:20 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731 , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments...
Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil>
Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload
Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload
Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments...
Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false
Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment...
Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment.
Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment
Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments...
Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces.
Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments...
Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil>
Duration: 2.484767974s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
288.549669ms target:
https://us1.storj.io/login
FAIL (2025-07-14 22:48:20 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39510->127.0.0.1:53: i/o timeout
Duration: 288.604132ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
332.71548ms target:
https://version.storj.io/
FAIL (2025-07-14 22:48:16 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 332.743582ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.12540034s
FAIL (2025-07-14 22:48:05 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:48375->127.0.0.1:53: i/o timeout
Duration: 1.125441426s
edge
gateway
us-select-1
|