Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 186866 reports (Page 3512 of 3738)
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
1.557781597s
FAIL (2025-07-14 23:25:35 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.557814692s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
909.268569ms
FAIL (2025-07-14 23:25:27 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 909.300381ms core uplink us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip:
2 out of 60 is failed (threshold=3) [.X...............................................X..........]
duration:
787.035956ms
FAIL (2025-07-14 23:25:26 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:53438->127.0.0.1:53: i/o timeout
Duration: 787.064341ms edge authservice http bgp ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [......X..............................X......................]
duration:
2.787492431s
FAIL (2025-07-14 23:25:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.787516578s edge gateway us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
512.874413ms
target:
https://ap1.storj.io/login
FAIL (2025-07-14 23:25:15 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:36212->127.0.0.1:53: i/o timeout
Duration: 512.905617ms core satellite ap1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
339.480978ms
FAIL (2025-07-14 23:25:07 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 339.509821ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
2.540976589s
FAIL (2025-07-14 23:25:05 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731     , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments...
Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil>
Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload
Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload
Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments...
Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false
Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment...
Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment.
Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114    , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627     , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079    , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940     , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047     , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975     , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771     , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186    , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006     , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699     , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734     , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221    , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007     , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293    , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878     , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222    , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment
Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments...
Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221    , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007     , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186    , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222    , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079    , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293    , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006     , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114    , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878     , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771     , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699     , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975     , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940     , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces.
Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627     , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734     , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047     , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments...
Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil>
Duration: 2.541047171s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
3 out of 60 is failed (threshold=3) [...X.................................................XX.....]
duration:
2.869334067s
FAIL (2025-07-14 23:24:57 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:53438->127.0.0.1:53: i/o timeout
Duration: 2.869359281s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip:
2 out of 60 is failed (threshold=3) [..X...............................................X.........]
duration:
763.128091ms
FAIL (2025-07-14 23:24:57 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:53438->127.0.0.1:53: i/o timeout
Duration: 763.169572ms edge authservice http bgp ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
3 out of 60 is failed (threshold=3) [....XX................................................X.....]
duration:
535.601169ms
FAIL (2025-07-14 23:24:52 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:54371->127.0.0.1:53: i/o timeout
Duration: 535.624372ms edge authservice http bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
869.995216ms
FAIL (2025-07-14 23:24:51 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 870.022634ms core uplink us1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
356.902287ms
target:
https://version.storj.io/
FAIL (2025-07-14 23:24:48 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 356.931183ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..........X..........................X......................]
duration:
1.035076055s
FAIL (2025-07-14 23:24:40 UTC)
orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/gateway-tests/from_do_prod_ops_orbiter_eu_0/1K?x-id=PutObject": dial tcp: lookup s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:57187->127.0.0.1:53: i/o timeout
Duration: 1.035098546s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration:
271.345137ms
target:
https://us1.storj.io/login
FAIL (2025-07-14 23:24:39 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39510->127.0.0.1:53: i/o timeout
Duration: 271.371005ms core satellite us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip:
2 out of 60 is failed (threshold=3) [...X...............................................X........]
duration:
821.68618ms
FAIL (2025-07-14 23:24:36 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:53438->127.0.0.1:53: i/o timeout
Duration: 821.716898ms edge authservice http bgp ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.......X..............................X.....................]
duration:
2.786237527s
FAIL (2025-07-14 23:24:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.786273439s edge gateway us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
1.567737267s
FAIL (2025-07-14 23:24:33 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.56776391s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
947.91475ms
FAIL (2025-07-14 23:24:20 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 948.015598ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
2.421306216s
FAIL (2025-07-14 23:24:17 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731     , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments...
Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil>
Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload
Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload
Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments...
Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false
Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment...
Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment.
Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114    , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627     , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079    , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940     , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047     , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975     , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771     , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186    , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006     , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699     , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734     , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221    , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007     , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293    , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878     , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222    , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment
Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments...
Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221    , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007     , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186    , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222    , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079    , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293    , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006     , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114    , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878     , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771     , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699     , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975     , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940     , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces.
Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627     , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734     , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047     , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments...
Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil>
Duration: 2.421336104s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
3 out of 60 is failed (threshold=3) [....X.................................................XX....]
duration:
2.747039991s
FAIL (2025-07-14 23:24:16 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:53438->127.0.0.1:53: i/o timeout
Duration: 2.747071548s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
503.083595ms
target:
https://ap1.storj.io/login
FAIL (2025-07-14 23:24:09 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:36212->127.0.0.1:53: i/o timeout
Duration: 503.147795ms core satellite ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
1.552040365s
FAIL (2025-07-14 23:24:07 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.552072692s core uplink ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip:
2 out of 60 is failed (threshold=3) [....X...............................................X.......]
duration:
1.309651244s
FAIL (2025-07-14 23:24:07 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:53438->127.0.0.1:53: i/o timeout
Duration: 1.309680839s edge authservice http bgp ap1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
352.908585ms
FAIL (2025-07-14 23:23:56 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 352.968843ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................]
duration:
748.968302ms
target:
https://us1.storj.io/login
FAIL (2025-07-14 23:23:54 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39510->127.0.0.1:53: i/o timeout
Duration: 748.996665ms core satellite us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
3 out of 60 is failed (threshold=3) [.....XX................................................X....]
duration:
539.941091ms
FAIL (2025-07-14 23:23:53 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:54371->127.0.0.1:53: i/o timeout
Duration: 539.96794ms edge authservice http bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [........X..............................X....................]
duration:
2.673639063s
FAIL (2025-07-14 23:23:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.673663571s edge gateway us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
1.516176515s
FAIL (2025-07-14 23:23:50 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.516210428s core uplink ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [...........X..........................X.....................]
duration:
1.262920475s
FAIL (2025-07-14 23:23:49 UTC)
orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/gateway-tests/from_do_prod_ops_orbiter_eu_0/1K?x-id=PutObject": dial tcp: lookup s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:57187->127.0.0.1:53: i/o timeout
Duration: 1.262943328s edge gateway us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
331.835688ms
target:
https://version.storj.io/
FAIL (2025-07-14 23:23:39 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 331.86651ms core website
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
327.90334ms
FAIL (2025-07-14 23:23:38 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 327.930945ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
271.808249ms
target:
https://us1.storj.io/login
FAIL (2025-07-14 23:23:34 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39510->127.0.0.1:53: i/o timeout
Duration: 271.838065ms core satellite us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip:
2 out of 60 is failed (threshold=3) [.....X...............................................X......]
duration:
856.335104ms
FAIL (2025-07-14 23:23:34 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:53438->127.0.0.1:53: i/o timeout
Duration: 856.367824ms edge authservice http bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
920.318251ms
FAIL (2025-07-14 23:23:24 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 920.348874ms core uplink us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
1.56594882s
FAIL (2025-07-14 23:23:18 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.565991623s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
2.430858123s
FAIL (2025-07-14 23:23:16 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731     , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments...
Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil>
Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload
Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload
Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments...
Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false
Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment...
Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment.
Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114    , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627     , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079    , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940     , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047     , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975     , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771     , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186    , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006     , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699     , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734     , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221    , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007     , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293    , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878     , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222    , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment
Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments...
Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221    , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007     , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186    , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222    , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079    , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293    , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006     , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114    , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878     , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771     , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699     , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975     , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940     , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces.
Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627     , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734     , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047     , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments...
Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil>
Duration: 2.430894761s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
329.938606ms
target:
https://version.storj.io/
FAIL (2025-07-14 23:23:16 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 329.960442ms core website
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
548.000177ms
target:
https://ap1.storj.io/login
FAIL (2025-07-14 23:23:16 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:36212->127.0.0.1:53: i/o timeout
Duration: 548.021933ms core satellite ap1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
3 out of 60 is failed (threshold=3) [.....X.................................................XX...]
duration:
2.934853808s
FAIL (2025-07-14 23:23:11 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:53438->127.0.0.1:53: i/o timeout
Duration: 2.93488052s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [............X..........................X....................]
duration:
1.103493888s
FAIL (2025-07-14 23:23:10 UTC)
orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/gateway-tests/from_do_prod_ops_orbiter_eu_0/1K?x-id=PutObject": dial tcp: lookup s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:57187->127.0.0.1:53: i/o timeout
Duration: 1.103516542s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
321.371341ms
FAIL (2025-07-14 23:23:06 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout
Duration: 321.400643ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
3 out of 60 is failed (threshold=3) [......XX................................................X...]
duration:
541.164069ms
FAIL (2025-07-14 23:22:55 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:54371->127.0.0.1:53: i/o timeout
Duration: 541.195091ms edge authservice http bgp us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
620.354412ms
target:
https://us1.storj.io/login
FAIL (2025-07-14 23:22:54 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39510->127.0.0.1:53: i/o timeout
Duration: 620.379151ms core satellite us1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
364.381746ms
target:
https://version.storj.io/
FAIL (2025-07-14 23:22:47 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout
Duration: 364.409794ms core website
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip:
2 out of 60 is failed (threshold=3) [......X...............................................X.....]
duration:
1.371114856s
FAIL (2025-07-14 23:22:46 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:53438->127.0.0.1:53: i/o timeout
Duration: 1.371142238s edge authservice http bgp ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.........X..............................X...................]
duration:
2.55172645s
FAIL (2025-07-14 23:22:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.551752504s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
2.367825891s
FAIL (2025-07-14 23:22:39 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731     , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments...
Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil>
Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload
Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload
Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments...
Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false
Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment...
Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment.
Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114    , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627     , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079    , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940     , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047     , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975     , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771     , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186    , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006     , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699     , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734     , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221    , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007     , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293    , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878     , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222    , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece...
Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment
Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments...
Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221    , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007     , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186    , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222    , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079    , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293    , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006     , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114    , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878     , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771     , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699     , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975     , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940     , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil>
Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces.
Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627     , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734     , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047     , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF
Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments...
Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil>
Duration: 2.367853122s core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
1.496789088s
FAIL (2025-07-14 23:22:29 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.496820072s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
913.48809ms
FAIL (2025-07-14 23:22:27 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 913.52363ms core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
3 out of 60 is failed (threshold=3) [......X.................................................XX..]
duration:
3.004171127s
FAIL (2025-07-14 23:22:27 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:53438->127.0.0.1:53: i/o timeout
Duration: 3.004240251s core uplink us-select-1 us1-placement-20