Orbiter History

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 341.005178ms target: https://version.storj.io/ FAIL (2025-07-14 23:15:29 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout Duration: 341.043638ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.394607277s FAIL (2025-07-14 23:15:25 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731 , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments... Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil> Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments... Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment... Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment. Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments... Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces. Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments... Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil> Duration: 2.394665018s core uplink us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 789.274273ms FAIL (2025-07-14 23:15:15 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout Duration: 789.320988ms edge authservice http bgp ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1) antiblip: 2 out of 60 is failed (threshold=3) [........XX..................................................] duration: 310.879418ms FAIL (2025-07-14 23:15:12 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout Duration: 310.907899ms edge authservice http bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.962195528s FAIL (2025-07-14 23:15:05 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout Duration: 2.962224367s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 2 out of 60 is failed (threshold=3) [................XX..........................................] duration: 604.624883ms FAIL (2025-07-14 23:15:04 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout Duration: 604.674246ms edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 349.541583ms FAIL (2025-07-14 23:15:02 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout Duration: 349.578808ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X..............................X..........] duration: 2.732147755s FAIL (2025-07-14 23:14:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.732179584s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 281.125288ms target: https://us1.storj.io/login FAIL (2025-07-14 23:14:55 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39510->127.0.0.1:53: i/o timeout Duration: 281.158855ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 874.020083ms FAIL (2025-07-14 23:14:50 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 874.075981ms core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.677165656s FAIL (2025-07-14 23:14:47 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout Duration: 2.67718791s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.394698543s FAIL (2025-07-14 23:14:37 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731 , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments... Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil> Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments... Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment... Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment. Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments... Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces. Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments... Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil> Duration: 2.394723044s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................X..........................X..........] duration: 1.045660772s FAIL (2025-07-14 23:14:37 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/gateway-tests/from_do_prod_ops_orbiter_eu_0/1K?x-id=PutObject": dial tcp: lookup s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:57187->127.0.0.1:53: i/o timeout Duration: 1.046139724s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 826.638432ms FAIL (2025-07-14 23:14:30 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout Duration: 826.67055ms edge authservice http bgp ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 2 out of 60 is failed (threshold=3) [.................XX.........................................] duration: 559.028443ms FAIL (2025-07-14 23:14:28 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout Duration: 559.05859ms edge authservice http bgp us1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 330.283238ms target: https://version.storj.io/ FAIL (2025-07-14 23:14:25 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout Duration: 330.316152ms core website
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 350.045938ms FAIL (2025-07-14 23:14:23 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout Duration: 350.101076ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1) antiblip: 2 out of 60 is failed (threshold=3) [.........XX.................................................] duration: 779.286655ms FAIL (2025-07-14 23:14:21 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout Duration: 779.316866ms edge authservice http bgp eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X..............................X.........] duration: 2.671687311s FAIL (2025-07-14 23:14:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.671713778s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 914.48098ms FAIL (2025-07-14 23:14:18 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 914.511032ms core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 650.8078ms target: https://us1.storj.io/login FAIL (2025-07-14 23:14:13 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39510->127.0.0.1:53: i/o timeout Duration: 650.834211ms core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 3.069419119s FAIL (2025-07-14 23:14:08 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout Duration: 3.069467173s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.324234939s FAIL (2025-07-14 23:14:07 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout Duration: 1.324263819s edge authservice http bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.424393821s FAIL (2025-07-14 23:14:00 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731 , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments... Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil> Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments... Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment... Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment. Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments... Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces. Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments... Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil> Duration: 2.424447519s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X..............................X........] duration: 2.748161249s FAIL (2025-07-14 23:13:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.748243111s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1) antiblip: 2 out of 60 is failed (threshold=3) [..........XX................................................] duration: 339.136012ms FAIL (2025-07-14 23:13:55 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout Duration: 339.163499ms edge authservice http bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 895.713247ms FAIL (2025-07-14 23:13:54 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 895.767876ms core uplink us1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 321.579983ms FAIL (2025-07-14 23:13:53 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout Duration: 321.664875ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 334.875158ms target: https://version.storj.io/ FAIL (2025-07-14 23:13:48 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout Duration: 334.900193ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.367183424s FAIL (2025-07-14 23:13:44 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731 , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments... Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil> Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments... Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment... Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment. Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments... Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces. Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments... Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil> Duration: 2.367217834s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................X..........................X.........] duration: 1.056474336s FAIL (2025-07-14 23:13:40 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/gateway-tests/from_do_prod_ops_orbiter_eu_0/1K?x-id=PutObject": dial tcp: lookup s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:57187->127.0.0.1:53: i/o timeout Duration: 1.056505413s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 2 out of 60 is failed (threshold=3) [..................XX........................................] duration: 597.341853ms FAIL (2025-07-14 23:13:36 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout Duration: 597.374633ms edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1) antiblip: 2 out of 60 is failed (threshold=3) [...........XX...............................................] duration: 389.218317ms FAIL (2025-07-14 23:13:35 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout Duration: 389.281836ms edge authservice http bgp eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X..............................X.......] duration: 2.844894642s FAIL (2025-07-14 23:13:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.84491857s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.964416078s FAIL (2025-07-14 23:13:15 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout Duration: 2.964718682s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 905.114242ms FAIL (2025-07-14 23:13:14 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 905.141764ms core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 654.539111ms target: https://us1.storj.io/login FAIL (2025-07-14 23:13:14 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39510->127.0.0.1:53: i/o timeout Duration: 654.561992ms core satellite us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 2 out of 60 is failed (threshold=3) [...................XX.......................................] duration: 1.100227907s FAIL (2025-07-14 23:13:01 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout Duration: 1.100258453s edge authservice http bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................X..........................X........] duration: 1.094666025s FAIL (2025-07-14 23:13:00 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/gateway-tests/from_do_prod_ops_orbiter_eu_0/1K?x-id=PutObject": dial tcp: lookup s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:57187->127.0.0.1:53: i/o timeout Duration: 1.094691659s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 961.14368ms FAIL (2025-07-14 23:12:58 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 961.242131ms core uplink us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 758.912927ms FAIL (2025-07-14 23:12:57 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout Duration: 758.938637ms edge authservice http bgp ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X..............................X......] duration: 2.573181067s FAIL (2025-07-14 23:12:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.573206198s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 324.665078ms FAIL (2025-07-14 23:12:53 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50937->127.0.0.1:53: i/o timeout Duration: 324.689954ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 335.450835ms target: https://version.storj.io/ FAIL (2025-07-14 23:12:48 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp: lookup version.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39897->127.0.0.1:53: i/o timeout Duration: 335.50797ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.468383267s FAIL (2025-07-14 23:12:43 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 8.206359976 (517h32m58.089773601s) [noise=true , address=104.36.82.2:4731 , piece_id=B3PWURON6BXLH5A5MAUQR6AV7GCKI7BAFL5BNZWVK2RVMBXB46GQ, seg_pos={0 0}, upload=413907]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 14 22:43:58.206377339 (517h32m58.089790968s) [seg_pos={0 0}, upload=413907]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 14 22:43:58.206444718 (517h32m58.089858345s) [upload=413907]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 22:43:58.206449463 (517h32m58.089863088s) [upload=413907]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 22:43:58.347165991 (517h32m58.230579604s) [upload=413907]: Done uploading segments... Jul 14 22:43:58.347205793 (517h32m58.230619405s) [upload=413907]: Upload finished. err: <nil> Jul 14 22:44:42.015713783 (517h33m41.899127412s) [upload=413918]: Starting upload Jul 14 22:44:42.015834369 (517h33m41.899248002s) [upload=413918]: Done starting upload Jul 14 22:44:42.016026318 (517h33m41.899439933s) [upload=413918]: Uploading segments... Jul 14 22:44:42.016162714 (517h33m41.899576341s) [upload=413918]: Got next segment. Inline: false Jul 14 22:44:42.016324948 (517h33m41.899738577s) [upload=413918]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 22:44:42.016332974 (517h33m41.899746601s) [upload=413918]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 14 22:44:42.135948823 (517h33m42.019362441s) [seg_pos={0 0}, upload=413918]: Begin upload segment... Jul 14 22:44:42.135999810 (517h33m42.019423344s) [seg_pos={0 0}, upload=413918]: Done begin upload segment. Jul 14 22:44:42.136043515 (517h33m42.019457144s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.136593766 (517h33m42.020007395s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.136909879 (517h33m42.020323509s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.137003608 (517h33m42.020417237s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.137497617 (517h33m42.020911243s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.137567172 (517h33m42.020980802s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138117531 (517h33m42.021531167s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138178140 (517h33m42.021591766s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138743598 (517h33m42.022157225s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.138793414 (517h33m42.022207047s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.139365974 (517h33m42.02277961s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.139844282 (517h33m42.023257911s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.140123571 (517h33m42.023537204s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.140570645 (517h33m42.023984285s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.141198196 (517h33m42.024611829s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.141502537 (517h33m42.024916166s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Uploading piece... Jul 14 22:44:42.745504554 (517h33m42.628918185s) [upload=413918]: Next returned nil segment Jul 14 22:44:42.745524599 (517h33m42.628938212s) [upload=413918]: Waiting for error group managing segments... Jul 14 22:44:42.918446191 (517h33m42.801859808s) [noise=true , address=104.36.82.14:4221 , piece_id=L4BBBPGSSXOXTHHTZJAR4HJHO2YF4IF2PZS7LBPZPUJXB7BQO2OQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.918817885 (517h33m42.802231501s) [noise=true , address=104.36.82.9:4007 , piece_id=L2JF6UIFOO6CAGKMC7ZPEFTIULACDL7ETQIZ73WHPMGW3ZTIC2UA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.923249497 (517h33m42.806663114s) [noise=true , address=104.36.82.13:4186 , piece_id=LBQAWOSSV2DZDE2INQB5PH3KMHUSRR4CTZIGPCLPPH4S7PUKH2WA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.924728054 (517h33m42.808141666s) [noise=true , address=104.36.82.14:4222 , piece_id=G5ZJOSQ4YWCMBLCSRPVHTGAJEZA7PLNOX3Q6NXIAWC2YBHP6LRTQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.926153430 (517h33m42.80956706s) [noise=true , address=104.36.82.10:4079 , piece_id=36YVYVJQWYITO4FDDXKFD5PTUN2DSHSLL2223AMW5AXMFQKSCXLA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.930049556 (517h33m42.813463168s) [noise=true , address=104.36.82.16:4293 , piece_id=5QGJQALYFIBG2MG2OZ4F2XXFYIJRGIGR33CLDJXZXRWN3QBPZY2Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.932193893 (517h33m42.81560751s) [noise=true , address=104.36.82.9:4006 , piece_id=AQ5XAQRMWSZNCI36ZDXIQ6TBB674Y467YEBA2SIFSOOMGHPKVKAA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.940893419 (517h33m42.824307054s) [noise=true , address=104.36.82.11:4114 , piece_id=WILP5PUDAPE3DLES4OUJKTD5M3TG3THPRBK6VXEVAXIJ4NM5XPDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.954717001 (517h33m42.838130614s) [noise=true , address=77.90.31.21:4878 , piece_id=ZIW2UI25AAYJMSAATQV6DIMDCFG5S5G6CBV4MLKCMKNXV4FXDJBA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.961692262 (517h33m42.845105874s) [noise=true , address=77.90.31.17:4771 , piece_id=DMH5I55KT7BMQNLCFIMIM7NPPGNYHXWJL2WLWUQVB3BEMZKQTFGQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.961791857 (517h33m42.845205478s) [noise=true , address=77.90.31.15:4699 , piece_id=23GSSQE5CH2KKRTKKQH6COKF3MIH56FXPSWFW2X5VDN7W7TA3N5Q, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.967396358 (517h33m42.850809981s) [noise=true , address=45.91.116.6:4975 , piece_id=TAXUMNBT34DZBB4TVOGT3P4FYQ5UBGKJ6BPUWOWEXNDLA3MR4DDA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.979144764 (517h33m42.862558377s) [noise=true , address=45.91.116.4:4940 , piece_id=PRKM7OVJU2YH2Q5OMCVUCA3JLSZKQEMLVYBKTCORN2BHPRYMRNGA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: <nil> Jul 14 22:44:42.979172434 (517h33m42.862586061s) [seg_pos={0 0}, upload=413918]: Segment reached optimal threshold of 13 pieces. Jul 14 22:44:42.979395117 (517h33m42.862808729s) [noise=true , address=77.90.31.13:4627 , piece_id=GTCK2SMJH3UWKER2Y6OYX7QEJNBXVTUZRQS43GAB7EKIU5NLQMZQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: expected piece hash; context canceled; EOF Jul 14 22:44:42.979489615 (517h33m42.862903228s) [noise=true , address=77.90.31.16:4734 , piece_id=3D2YOCS5NCW5MXDTIOV63FWPZZLTUXEOCD6UJ4T3GMOLYIQX4JXA, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF Jul 14 22:44:42.979616603 (517h33m42.863030216s) [noise=true , address=45.91.116.8:4047 , piece_id=S6APWFSBVGZFXAHDOQHIHHLGKMARWWKMQEWVBIRJSMSYS7AG3XLQ, seg_pos={0 0}, upload=413918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Jul 14 22:44:42.979638706 (517h33m42.863052333s) [seg_pos={0 0}, upload=413918]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 14 22:44:42.979715553 (517h33m42.863129179s) [upload=413918]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 14 22:44:42.979720340 (517h33m42.863133966s) [upload=413918]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 22:44:43.254410244 (517h33m43.137823874s) [upload=413918]: Done uploading segments... Jul 14 22:44:43.254434024 (517h33m43.137847655s) [upload=413918]: Upload finished. err: <nil> Duration: 2.468439019s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 3.749283385s FAIL (2025-07-14 23:12:42 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout Duration: 3.749328928s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1) antiblip: 2 out of 60 is failed (threshold=3) [............XX..............................................] duration: 289.648611ms FAIL (2025-07-14 23:12:35 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41122->127.0.0.1:53: i/o timeout Duration: 289.677325ms edge authservice http bgp eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 2 out of 60 is failed (threshold=3) [....................XX......................................] duration: 543.531336ms FAIL (2025-07-14 23:12:33 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:50927->127.0.0.1:53: i/o timeout Duration: 543.568065ms edge authservice http bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X..............................X.....] duration: 2.557790677s FAIL (2025-07-14 23:12:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.557814197s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X..........................X.......] duration: 1.185648364s FAIL (2025-07-14 23:12:20 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/gateway-tests/from_do_prod_ops_orbiter_eu_0/1K?x-id=PutObject": dial tcp: lookup s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:57187->127.0.0.1:53: i/o timeout Duration: 1.185668887s edge gateway us-select-1

Orbiter Check History

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)