Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X...........X...........................................] duration: 1.131867618s trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 18:08:33 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.131900251s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..X..........X...X..........................................] duration: 1.667677309s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 18:08:33 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.667936584s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.460537108s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 18:08:26 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.460576331s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........X....X........X....................................] duration: 923.209926ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 18:08:06 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 923.236767ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................XX................................] duration: 2.317763168s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 18:08:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.317793443s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [.....X......X.X.X.XX..XX.X..................................] duration: 289.80814ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 18:07:58 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 289.82987ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X...........X..........................................] duration: 874.527748ms trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 18:07:57 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 874.56004ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.634605987s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 18:07:52 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.634634774s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...XX.......................................................] duration: 2.871160896s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 18:07:39 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.871221718s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...X..........X...X.........................................] duration: 1.6395514s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 18:07:33 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.639582144s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................XX...............................] duration: 2.332474412s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 18:07:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.332505746s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [......X......X.X.X.XX..XX.X.................................] duration: 285.39537ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 18:07:18 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 285.424375ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........X....X........X...................................] duration: 942.212042ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 18:07:15 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 942.26106ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X...........X.........................................] duration: 939.829257ms trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 18:07:02 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 939.865351ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.621703835s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 18:06:42 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.6218105s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................XX..............................] duration: 2.369093254s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 18:06:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.36911855s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....XX......................................................] duration: 2.115973202s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 18:06:29 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.115996552s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [....X..........X...X........................................] duration: 1.570694314s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 18:06:29 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.570738936s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X....X........X..................................] duration: 995.234135ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 18:06:17 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 995.265012ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration: 2.208111011s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 18:06:13 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.208157048s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [.......X......X.X.X.XX..XX.X................................] duration: 292.654792ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 18:06:03 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 292.685932ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X...........X........................................] duration: 920.312422ms trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 18:06:00 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 920.478661ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.....X..........X...X.......................................] duration: 2.121716428s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 18:05:57 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 2.121747396s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.445505736s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 18:05:50 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.445536672s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................XX.............................] duration: 2.409106165s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 18:05:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.409135164s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X...........X.......................................] duration: 1.092886093s trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 18:05:30 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.092920175s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......XX....................................................] duration: 2.214951789s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 18:05:27 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.215028631s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [........X......X.X.X.XX..XX.X...............................] duration: 293.604906ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 18:05:21 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 293.637114ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [............X....X........X.................................] duration: 914.98896ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 18:05:16 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 915.036153ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.249892556s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 18:05:10 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.249993506s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [......X..........X...X......................................] duration: 1.673809365s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 18:05:05 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.67384567s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X...........X......................................] duration: 1.120157777s trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 18:05:01 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.120250332s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......XX...................................................] duration: 2.713870362s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 18:04:57 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.713911829s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [.........X......X.X.X.XX..XX.X..............................] duration: 293.101413ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 18:04:43 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 293.13035ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.494670857s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 18:04:35 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.494699122s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................XX............................] duration: 2.370574082s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 18:04:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.37059323s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X...........X.....................................] duration: 909.497961ms trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 18:04:24 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 909.544361ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........XX..................................................] duration: 2.439615722s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 18:04:13 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.439642578s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.......X..........X...X.....................................] duration: 1.648697501s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 18:04:10 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.648718986s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............X....X........X................................] duration: 901.824088ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 18:04:08 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 901.853685ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 2.32730945s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 18:04:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.327407607s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [..........X......X.X.X.XX..XX.X.............................] duration: 302.119229ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 18:03:54 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 302.214919ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........XX.................................................] duration: 2.544486464s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 18:03:32 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.544522165s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.345344652s trace: https://jaeger.dev.storj.io/trace/667af7ecec748423 FAIL (2025-11-08 18:03:28 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.345375173s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [........X..........X...X....................................] duration: 1.710465333s trace: https://jaeger.dev.storj.io/trace/6bb9e3317e182100 FAIL (2025-11-08 18:03:26 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded Duration: 1.710489126s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................XX..........................] duration: 2.600008015s trace: https://jaeger.dev.storj.io/trace/69a842eacf594af2 FAIL (2025-11-08 18:03:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Nov 8 17:40:10.804199015 (221h59m13.505791471s) [upload=195222]: Starting upload Nov 8 17:40:10.804309456 (221h59m13.505901906s) [upload=195222]: Done starting upload Nov 8 17:40:10.804406258 (221h59m13.505998698s) [upload=195222]: Uploading segments... Nov 8 17:40:10.804661289 (221h59m13.506253725s) [upload=195222]: Got next segment. Inline: false Nov 8 17:40:10.804719099 (221h59m13.506311551s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 8 17:40:10.804725438 (221h59m13.506317891s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 8 17:40:10.949670396 (221h59m13.651262854s) [seg_pos={0 0}, upload=195222]: Begin upload segment... Nov 8 17:40:10.949746707 (221h59m13.651339142s) [seg_pos={0 0}, upload=195222]: Done begin upload segment. Nov 8 17:40:10.949790013 (221h59m13.651382473s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950253370 (221h59m13.65184583s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950807476 (221h59m13.652399944s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.950980887 (221h59m13.652573364s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951299826 (221h59m13.652892277s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951606289 (221h59m13.653198938s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.951724371 (221h59m13.653316822s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952145494 (221h59m13.653737946s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952213692 (221h59m13.653806149s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.952860843 (221h59m13.654453304s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.953456202 (221h59m13.655048664s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.954613710 (221h59m13.656206169s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.955958107 (221h59m13.657550571s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.956631592 (221h59m13.658224053s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.958408615 (221h59m13.660001073s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:10.960102983 (221h59m13.661695424s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Uploading piece... Nov 8 17:40:11.554414981 (221h59m14.256007458s) [upload=195222]: Next returned nil segment Nov 8 17:40:11.554435392 (221h59m14.256027861s) [upload=195222]: Waiting for error group managing segments... Nov 8 17:40:11.692643728 (221h59m14.394236176s) [noise=true , address=45.91.116.7:4009 , piece_id=ODWUQB5ECHFVLCNT7ITGFAVWLCSM6LBIVZFY5SKBO4PRSUTMOMZQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.694922910 (221h59m14.396515359s) [noise=true , address=145.79.227.27:4690 , piece_id=AN2BZBRPGNKZJD5QULYN6NQVBA5MAUPNJDPKXRGNJ5JGIE6IWB6Q, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.696239693 (221h59m14.397832128s) [noise=true , address=77.90.31.11:4555 , piece_id=7CLWZCMGVXWS36F2CDJSVLWQRF3FSTRSUGOR7UVAXE6HUJS6V3UQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.704279553 (221h59m14.405872002s) [noise=true , address=145.79.227.20:4437 , piece_id=VSIHFVU3Q7SHJHMUZIVJLHZGOVSXTWH3NAIX4J4ZD65NVVG5V7XQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708695617 (221h59m14.410288057s) [noise=true , address=145.79.227.8:4329 , piece_id=TQPKCTCJY3ELZWXGYPL4SZK2RSRQCACPYBUTID32RHHMOTPMPDAA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.708860281 (221h59m14.410452732s) [noise=true , address=145.79.227.30:4763 , piece_id=POFXWZ7WXWFPMDWOWYRZKL67GHGMU5EZZN43HK5TLIAQ55QVWM4A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.709384760 (221h59m14.410977212s) [noise=true , address=145.79.227.31:4799 , piece_id=J2VT3EXBVJ6MKB2BJWXCAFFXEVM4252KDWEU3OVN3ZQAM4WVZTOA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710418945 (221h59m14.412011393s) [noise=true , address=77.90.31.15:4699 , piece_id=QR3Y5CPZUMRTPJMRPNHVCSMB36GX535CPSAIOARS5IBUODCE5LVA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.710576422 (221h59m14.412168861s) [noise=true , address=145.79.227.2:4114 , piece_id=4MDCN7P2JUQ7S62EJPJ7HDWDJPBWDNAHS4CS6QXJPKHNMDX3BN7A, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713641307 (221h59m14.415233755s) [noise=true , address=45.91.116.12:4226 , piece_id=NSVBQ4V2ATLOSMHQKJEVS5YO63QHGEK2L2WCA5JXCUX3XDNWLZPQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.713802367 (221h59m14.415394815s) [noise=true , address=145.79.227.14:4838 , piece_id=SVTJ5R62XOK4ZKYBOZKWTEHUIB4FZFN7BI7S6C23VRBO6T2MTUAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.715278378 (221h59m14.416870828s) [noise=true , address=45.91.116.7:4010 , piece_id=YDUKICF5PG5BRCEITK2OOI2KYIHZPL6CMQ22SDQ3OC3O3YYIHQGA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718089883 (221h59m14.419682337s) [noise=true , address=45.91.116.12:4227 , piece_id=CHHGEF6WCH5IHGAP4WLHGKFRL7NAHLB5WDCLGXOPBJUWTXYON2FA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: <nil> Nov 8 17:40:11.718111323 (221h59m14.419703784s) [seg_pos={0 0}, upload=195222]: Segment reached optimal threshold of 13 pieces. Nov 8 17:40:11.718414960 (221h59m14.420007418s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718423176 (221h59m14.420015623s) [noise=true , address=145.79.227.13:4803 , piece_id=TIKME7HJKZH3AJQUND4UTFJFHCFBAH7PYGUEBBL4LS2RCD2XSGTQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718551606 (221h59m14.420144063s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718564756 (221h59m14.420157212s) [noise=true , address=145.79.227.22:4510 , piece_id=AMMRIE4NKVKUHOFDKXSWT7JR4DJ75ECODZI7767BVW2ZOBMDNRAQ, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718608200 (221h59m14.420200645s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF Nov 8 17:40:11.718617070 (221h59m14.420209524s) [noise=true , address=77.90.31.14:4663 , piece_id=QEGZOKM3V3FDFHDWECT633YDLXRCP3G3NSPRL772UTBBQWTWJ5UA, seg_pos={0 0}, upload=195222]: Long tail cancellation due to optimal threshold Nov 8 17:40:11.718641555 (221h59m14.420234006s) [seg_pos={0 0}, upload=195222]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Nov 8 17:40:11.718729173 (221h59m14.420321626s) [upload=195222]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 8 17:40:11.718736122 (221h59m14.420328576s) [upload=195222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 8 17:44:48.551903088 (222h3m51.253495548s) [upload=195222]: Done uploading segments... Nov 8 17:44:48.551995784 (222h3m51.253588254s) [upload=195222]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.60006066s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............X....X........X...............................] duration: 903.854486ms trace: https://jaeger.dev.storj.io/trace/197ffda43a2a97c2 FAIL (2025-11-08 18:03:15 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 903.881419ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X...........X....................................] duration: 1.144389816s trace: https://jaeger.dev.storj.io/trace/507a0a6af90e29da FAIL (2025-11-08 18:03:11 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.144485337s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 9 out of 60 is failed (threshold=3) [...........X......X.X.X.XX..XX.X............................] duration: 296.229711ms target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/282d694e86fcb700 FAIL (2025-11-08 18:03:06 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 296.321425ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........XX................................................] duration: 2.423178807s trace: https://jaeger.dev.storj.io/trace/3ada5398ef16e7a5 FAIL (2025-11-08 18:03:05 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.423210021s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)