Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
3.291810984s
FAIL (2025-07-14 22:53:34 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 3.291836569s
core
uplink
ap1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
589.689362ms
FAIL (2025-07-14 22:53:32 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 589.751653ms
edge
authservice
http
bgp
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
1.134072113s
FAIL (2025-07-14 22:53:28 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:48375->127.0.0.1:53: i/o timeout
Duration: 1.134093598s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
2 out of 60 is failed (threshold=3) [........................................XX..................] duration:
344.459438ms
FAIL (2025-07-14 22:53:26 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 344.512724ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
2 out of 60 is failed (threshold=3) [..........................................XX................] duration:
573.422438ms
FAIL (2025-07-14 22:53:20 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 573.465149ms
edge
authservice
http
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.800779257s
FAIL (2025-07-14 22:53:19 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:45099->127.0.0.1:53: i/o timeout
Duration: 2.800815005s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
532.287621ms target:
https://ap1.storj.io/login
FAIL (2025-07-14 22:53:18 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:40128->127.0.0.1:53: i/o timeout
Duration: 532.316444ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
311.528472ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-07-14 22:53:17 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp: lookup uptime-checks-us-select.s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:50317->127.0.0.1:53: i/o timeout
Duration: 311.555247ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.50885087s
FAIL (2025-07-14 22:53:11 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731 , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments...
Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil>
Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload
Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload
Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments...
Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false
Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment...
Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment.
Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment
Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments...
Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces.
Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments...
Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil>
Duration: 2.508897832s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
332.789959ms target:
https://version.storj.io/
FAIL (2025-07-14 22:53:10 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 332.8199ms
core
website
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
2 out of 60 is failed (threshold=3) [...........................................XX...............] duration:
642.743992ms
FAIL (2025-07-14 22:53:02 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 642.780484ms
edge
authservice
http
bgp
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
3.571642389s
FAIL (2025-07-14 22:53:01 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 3.5716777s
core
uplink
ap1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
321.555616ms
FAIL (2025-07-14 22:53:00 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 321.624207ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
858.617003ms
FAIL (2025-07-14 22:52:51 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 858.77876ms
core
uplink
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
273.289695ms target:
https://us1.storj.io/login
FAIL (2025-07-14 22:52:51 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39510->127.0.0.1:53: i/o timeout
Duration: 273.366335ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
515.549059ms target:
https://ap1.storj.io/login
FAIL (2025-07-14 22:52:47 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:40128->127.0.0.1:53: i/o timeout
Duration: 515.576101ms
core
satellite
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.535399861s
FAIL (2025-07-14 22:52:45 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:45099->127.0.0.1:53: i/o timeout
Duration: 2.535422215s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
3.040045092s
FAIL (2025-07-14 22:52:43 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 3.040069012s
core
uplink
us-select-1
us1-placement-20
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
761.717587ms
FAIL (2025-07-14 22:52:43 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 761.797578ms
edge
authservice
http
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
334.152307ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-07-14 22:52:42 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp: lookup uptime-checks-us-select.s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:50317->127.0.0.1:53: i/o timeout
Duration: 334.182184ms
edge
gateway
vhost
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
2 out of 60 is failed (threshold=3) [.........................................XX.................] duration:
301.441268ms
FAIL (2025-07-14 22:52:37 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 301.469883ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
2 out of 60 is failed (threshold=3) [............................................XX..............] duration:
607.790807ms
FAIL (2025-07-14 22:52:26 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 607.814676ms
edge
authservice
http
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.074984503s
FAIL (2025-07-14 22:52:24 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:48375->127.0.0.1:53: i/o timeout
Duration: 1.075011996s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.562107653s
FAIL (2025-07-14 22:52:23 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731 , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments...
Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil>
Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload
Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload
Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments...
Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false
Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment...
Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment.
Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment
Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments...
Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces.
Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments...
Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil>
Duration: 2.562147312s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
539.321979ms target:
https://ap1.storj.io/login
FAIL (2025-07-14 22:52:20 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:40128->127.0.0.1:53: i/o timeout
Duration: 539.354986ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
3.242963355s
FAIL (2025-07-14 22:52:15 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 3.243000319s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
330.576689ms target:
https://version.storj.io/
FAIL (2025-07-14 22:52:12 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 330.607118ms
core
website
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
2 out of 60 is failed (threshold=3) [..........................................XX................] duration:
299.525926ms
FAIL (2025-07-14 22:52:08 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 299.562368ms
edge
authservice
http
bgp
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.677016941s
FAIL (2025-07-14 22:52:04 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:45099->127.0.0.1:53: i/o timeout
Duration: 2.67707494s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
326.053718ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-07-14 22:52:03 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp: lookup uptime-checks-us-select.s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:50317->127.0.0.1:53: i/o timeout
Duration: 326.083257ms
edge
gateway
vhost
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
782.27688ms
FAIL (2025-07-14 22:52:03 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 782.30641ms
edge
authservice
http
bgp
ap1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
327.34712ms
FAIL (2025-07-14 22:51:56 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 327.372878ms
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
533.527562ms target:
https://ap1.storj.io/login
FAIL (2025-07-14 22:51:53 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:40128->127.0.0.1:53: i/o timeout
Duration: 533.554798ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.372956595s
FAIL (2025-07-14 22:51:52 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731 , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments...
Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil>
Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload
Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload
Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments...
Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false
Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment...
Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment.
Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment
Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments...
Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces.
Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments...
Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil>
Duration: 2.372986321s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
365.5317ms target:
https://version.storj.io/
FAIL (2025-07-14 22:51:47 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 365.561513ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
916.979003ms
FAIL (2025-07-14 22:51:43 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 917.034429ms
core
uplink
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
273.407101ms target:
https://us1.storj.io/login
FAIL (2025-07-14 22:51:38 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39510->127.0.0.1:53: i/o timeout
Duration: 273.430163ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
509.94037ms target:
https://ap1.storj.io/login
FAIL (2025-07-14 22:51:38 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:40128->127.0.0.1:53: i/o timeout
Duration: 509.965573ms
core
satellite
ap1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
2 out of 60 is failed (threshold=3) [.............................................XX.............] duration:
537.146619ms
FAIL (2025-07-14 22:51:37 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 537.179241ms
edge
authservice
http
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
299.826514ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-07-14 22:51:34 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp: lookup uptime-checks-us-select.s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:50317->127.0.0.1:53: i/o timeout
Duration: 299.859276ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.749059657s
FAIL (2025-07-14 22:51:31 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout
Duration: 2.749089647s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.074181275s
FAIL (2025-07-14 22:51:31 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:48375->127.0.0.1:53: i/o timeout
Duration: 1.074219942s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
3.176390574s
FAIL (2025-07-14 22:51:23 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 3.176446947s
core
uplink
ap1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
850.340823ms
FAIL (2025-07-14 22:51:21 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 850.402697ms
edge
authservice
http
bgp
ap1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
327.785215ms
FAIL (2025-07-14 22:51:20 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 327.821309ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.683027772s
FAIL (2025-07-14 22:51:13 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:45099->127.0.0.1:53: i/o timeout
Duration: 2.683053952s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.470679206s
FAIL (2025-07-14 22:51:10 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731 , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments...
Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil>
Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload
Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload
Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments...
Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false
Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment...
Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment.
Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment
Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments...
Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces.
Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments...
Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil>
Duration: 2.470708991s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
524.366343ms target:
https://ap1.storj.io/login
FAIL (2025-07-14 22:51:05 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:40128->127.0.0.1:53: i/o timeout
Duration: 524.391514ms
core
satellite
ap1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
2 out of 60 is failed (threshold=3) [...........................................XX...............] duration:
333.980012ms
FAIL (2025-07-14 22:51:04 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout
Duration: 334.023422ms
edge
authservice
http
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
902.087493ms
FAIL (2025-07-14 22:50:53 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 902.118041ms
core
uplink
us1
|